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INTRODUCTION 

Major  advances  in  color  display  technology  have  been  evident  during  the  past  several 
years.  These  advances  have  been  accompanied  by  a  heightened  awareness  of  color- 
related  human  factors  issues.^The  recent  proliferation  of  new  color  display  applications 
can  thus  be  traced  to  two  interrelated  trends:  1)  a  growing  interest  in  the  potential 
advantages  of  a  color  information  display  for  enhancing  human  performance  in  complex 
man-machine  systems;  and  2)  the  availability  of  a  rapidly  evolving  display  technology  to 
support  advanced  color  display  concepts.  ■3  ^^- 

- 

The  translation  of  color  capability  into  an  operational  performance  advantage  is  both 
system-  and  task-specific.  The  color  coding  of  displayed  information,  when  applied 
correctly  and  systematically,  offers  the  greatest  potential  for  enhancing  operator 
performance  in  complex,  high-workload  situations  and  in  severe,  dynamic  operational 
environments.  These  conditions,  however,  impose  stringent  requirements  on  the  design 
of  both  the  color  display  system  and  human  operator  tasks.  An  obvious  application  of 
color  display  technology,  which  conforms  to  the  operational  task  and  environmental 
considerations  noted  above,  is  for  airborne  operations.  Piloting  and  airborne 
command/eontrol  tasks  involve  complex,  highly-dense  forms  of  information,  entail 
periodic  episodes  of  high  operator  workload,  and  are  often  performed  under  sub-optimal 
environmental  conditions. 

It  is  not  surprising  that  the  aerospace  and  aviation  communities  have  pursued  the 
integration  of  color  display  technology  into  advanced  airborne  systems.  However,  it  is 
perhaps  ironic  that  the  first  major  developments  of  flight-qualified,  full-color  electronic 
displays  were  initiated  by  the  commercial  and  general  aviation  sectors  of  the  industry. 
The  first  large-scale  integration  of  full-color  flight  displays  into  a  nev  generation  of 
aircraft  was  undertaken  by  the  Boeing  Commercial  Airplane  Company.  Figure  1  shows 
the  advanced  flight  deck  of  the  Boeing  Model  757/767  commercial  aircraft,  which 
incorporates  six  full-color,  high-resolution  shadow  mask  color  CRT  displays.  The  color 
displays  are  the  foundation  and  primary  pilot  interface  of  two  major  systems  on  the 
757/767.  The  Electronic  Flight  Instrument  System  (EFIS)  consists  of  electronic  ADI  and 
HSl  primary  flight  instruments.  A  second  system,  also  composed  of  two  displays, 
combines  centrally-located  Engine  Indication  and  Crew  Alerting  functions  (EICAS). 
Figure  2  shows  typical  enroute  display  formats  for  the  EADI  and  EHSI  components. 
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It  has  now  been  nearly  two  years  since  the  Boeing  Model  767  received  flight  certification 
by  the  Federal  Aviation  Administration,  with  t  Model  757  aircraft  following  close 
behind.  By  any  standards,  the  first  generation  of  full-color  flight  displays  have  been  an 
enormous  success,  receiving  virtually  unanimous  acclaim  by  the  technical  engineering 
and  pilot  communities.  Complimentary  cornmericai  programs  in  Europe  have  also  been 
successful,  leading  to  the  development  and  certification  of  an  advanced  color-CRT-based 
flight  deck  for  the  Airbus  Model  A3 10.  A  number  of  commercial  programs  involving  the 
retro-fit  of  electronic  color  displays  into  existing  flight  decks  are  currently  in  progress. 
In  addition,  experimental  color  display  development  and  evaluation  projects,  such  as  the 
Advanced  Flight  Deck  project  which  uses  a  BAC  1-11  aircraft  as  a  test  platform,  have 
been  ongoing  for  several  years. 

Significant  advances  have  also  been  made  in  the  general  aviation  market,  where  full- 
color  electronic  flight  displays  are  currently  offered  as  options  to  the  avionics 
complement  of  small  aircraft.  An  integrated  avionics  package,  incorporating  multiple 
electronic  color  displays,  is  now  being  developed  for  the  latest  version  of  the  Gulfstream 
IV  corporate  jet  aircraft. 

The  successful  development  and  integration  of  full-color,  shadow-mask  display 
technology  in  commercial  and  general  aviation  aircraft  have  prompted  a  resurgence  of 
interest  in  airborne  military  applications.  Despite  some  previous  experimental  test  and 
evaluation  programs  involving  color  display  concepts  for  use  in  military  systems,  the  first 
full-color  electronic  displays  developed  for  airborne  military  operations  in  production 
aircraft  are  only  now  on  the  horizon.  Several  color  systems  are  currently  in  the 
development  or  prototype  phases  and  include  both  front  cockpit  and  airborne 
command/control  applications.  Cockpit  displays  employing  shadow-mask  color  CRTs  are 
now  being  developed  for  the  F-15  fighter  aircraft  (see  Turner  &  Waruszewski,  1984)  and 
at  least  one  military  transport.  Full-color  airborne  command/control  displays  are  being 
developed  for  retro-fit  and  integration  with  existing  monitoring  systems  in  P-3  and 
AW  ACS  aircraft. 

In  the  future,  it  appears  likely  that  color  display  technology  will  be  a  part  of  most  new 
developments  in  manned  airborne  systems  (Waruszewski,  1981).  Color  offers  the 
potential  for  greatly  increasing  information  coding  flexibility  and  capability,  and  for 
reducing  visual  search  time  on  highly-dense  complex  displays.  This  increased  flexibility 
and  capability  will  in  turn  enable  the  development  of  more  integrated  and  veridical  forms 
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of  information  display,  such  us  the  pictorial  display  formats  currently  being  developed 
and  evaluated  in  a  program  sponsored  by  the  Air  Force  Flight  Dynamics  Laboratory 
(Raising,  1984).  The  ultimate  goal  of  all  advanced  color  display  development  programs  is 
increased  system  effectiveness  via  enhanced  performance  of  the  human  operator. 

While  it  is  easy  to  state  a  goal  of  increased  system  effectiveness,  defining  the  necessary 
steps  to  achieve  that  goal  or  the  methods  to  evaluate  the  success  of  a  particular  color 
display  application  are  difficult.  Advances  in  color  display  technology  have  been  rapid 
and  are  sure  to  continue.  Our  knowledge  of  how  the  human  operator  perceives, 
processes,  and  operates  on  color-coded  information  has  improved  accordingly.  The 
development  and  evaluation  of  effective  color  display  systems  must  be  based  upon  an 
integrated  approach  which  accounts  for  both  human  operator  characteristics  and  color 
display  system  characteristics.  A  coherent,  unified  body  of  knowledge  which  dictates  a 
generic  color  display  design  strategy  or  leads  to  meaningful  design  guidelines  does  not 
yet  exist.  Moreover,  the  goal  of  increased  aircrew  system  effectiveness  via  enhanced 
operator  performance  requires  a  carefully  planned  strategic  program  of  color  display 
design,  implementation,  and  evaluation. 

A  systematic  program  for  the  development  and  evaluation  of  airborne  color  divsplay 
systc-  ,s  has  recently  been  initiated  by  the  Systems  Engineering  Test  Directorate  of  the 
Naval  Air  Test  Center  (NATO),  with  cooperative  support  from  the  Federal  Aviation 
Administration.  The  remainder  of  this  paper  describes  the  overall  architecture  of  the 
program,  details  the  objectives  and  approach  for  current  program  activities,  and  focuses 
on  a  few  select  issues  of  interest  for  color  display  system  design. 


PROGRAM  OVERVIEW 

The  current  program  plan  for  NATC  sponsored  color  display  development  arid  evaluation 
activities  is  presented  in  flowchart  format  in  Figure  3.  The  program  is  structured 
according  to  three  major  program  phases.  Since  our  ultimate  goal  is  to  increase  aircrew 
system  effectiveness  by  enhancing  human  operator  performance,  the  program  structure 
is  essentially  "human  factors  driven"  and  can  be  mapped  onto  a  hierarchical  human 
factors  analysis  for  color  display  systems  (Silverstein,  in  press;  Silverstein  <k  Merrifield, 
1981)  as  shown  in  Figure  4. 
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Phase  I  of  the  program  focuses  on  fundamental  visual,  perceptual,  '•^iid  display  system 
considerations.  Color  display  design  guidelines  end  recommendations  are  developed  as 
they  relate  to  human  visual  and  perceptual  functions.  Display  system  hardware 
characteristics  and  measurement/specifieation  techniques  for  critical  color  display 
parameters  are  described.  The  initial  program  phase  also  Identifies  unresolved  issues  and 
future  color  Jisplay  research  requirements.  The  emphasis  of  Phase  II  is  on  the 
application  of  color  information  coding  to  a  variety  of  airborne  display  systems,  and  the 
definition  of  test  and  evalution  requirements  for  color  display  systems  hardware  and 
color-coded  display  formats.  The  final  phase  of  the  program.  Phase  III,  is  logically 
defined  as  the  mechanism  for  the  conduct  of  display  performance  evaluation.  In  this  last 
part  of  the  program,  detailed  test  plans  are  developed,  operational  performance 
evaluations  of  color  display  system  hardware  and  coded  information  formats  are 
conducted,  pilot/operator  primary  task  performance  is  analyzed  and  the  workload  impact 
of  new  display  concepts  is  assessed,  and  finally  required  modifications  or  improvements 
to  display  hardware  and/or  information  formats  are  documented. 

Currently,  we  are  approaching  the  completion  of  Phase  I  of  the  program.  We  have 
selected  the  F/A-18  and  its  complement  of  electronic  displays  as  our  initial  working 
model,  and  are  just  beginning  to  configure  a  preliminary  F/A-18  panel  mock-up  using 
Rockwell-Collins  (757/767)  shadow-mask  color  CRT  display  systems.  Symbol  generator 
software  for  this  preliminary  mock-up,  to  be  used  for  F/A-18  color  display  concept 
demonstrations  and  early  static  coding/forinat  evaluations,  is  now  being  developed. 

Considering  that  we  are  just  now  completing  Phase  1  of  the  program,  it  is  appropriate  to 
describe  the  scope  of  Phase  I  activities  in  somewhat  more  detail. 


PROGRAM  PHASE  I  DESCRIPTION 


The  initial  phase  of  the  program  has  been  sub-divided  into  two  major  tasks.  The  specific 
objectives  and  goals  for  each  Phase  1  task  are  as  follows: 

o  Task  1  -  Review  and  integration  of  the  current  philosphy  and  standards 
on  the  application  of  color  in  electronic  display  systems 

-  Emphasis  on  the  impact  of  color  on  display  visual  parameters 

-  Issues,  recommendations,  and  guidelines  for  color  display  operational 


■  ,■  -■  .•  -> 
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effectiveness 

o  Task  2  -  Survey  of  currently  available  color  display  systems 

-  Review  existing  system  capabilities 

-  Relate  functional  capabilities  of  available  systems  to  philosophy  and 
applications  standards 

-  Predict  future  trends  and  developments 

A  large  amount  of  information  has  been  assembled  and  integrated  in  order  to  satisfy  the 
objectives  of  the  first  task  of  the  program.  Therefore,  a  further  break-down  of  the 
topics  within  Task  1  v/ill  reveal  more  of  the  underlying  contents  and  strategy  of  this 
effort.  The  following  list  of  subtasks  provides  an  organization  according  to  four  major 
content  areas: 

0  Subtask  1  -  Principal  factors  determining  color  display 
effectiveness 

o  Subtask  2  -  Impact  of  the  operational  environment  on  color  display 
requirements  and  the  use  of  color  as  an  information 
coding  dimension 

0  Subtask  3  -  Color  display  specification,  measurement,  and 
calibration  techniques 

0  Subtask  4  -  Unresolved  issues  and  future  research  requirements 

The  subtasks  listed  above  can  in  turn  be  documented  with  more  meaningful  descriptors  to 
provide  a  more  comprehensive  overview  of  Phase  I: 

0  Subtask  1  -  Principal  factors  determining  color  display 
effectiveness 

0  Review  and  analysis  of  visual/perceptual  issues  and  their  impact  on 
color  display  characteristics 

-  Human  operator  and  display  systems  requirements  analyzed 
according  to  common  functional  units 

-  color  domain 

-  intensity  domain 

-  temporal  domain 

-  spatial  domain 

-  Provide  recommendations  and  guidelines  where  sufficient  support 


data  exist 

-  Identify  analytical  and  experimental  techniques  useful  for 
developing  and/or  verifying  system  specifications 

-  Indicate  data  voids  and  offer  qualified  recommendations 


o  Subtask  2  -  Impact  of  the  operational  environment  on  color  display 
requirements  and  the  use  of  color  as  an  information 
coding  dimension 

o  Identify  critical  environmental  variables  and  discuss  their  impact  on 
visual/perceptual  performance  and  color  display  characteristics 

-  Ambient  illumination  (color  temperature  and  intensity) 

-  analytical  color  modeling  techniques 

-  experimental  test  methods  for  display  parameter  verification 

-  compensation  characteristics  for  automatic  display 
brightness/contrast  control  systems 

-  Vibration 

-  effects  on  image  quality  and  visual  performance 

-  effects  on  display  structures 

0  Provide  recommendations  and  guidelines  where  sufficient  support 
data  exist 

o  Subtask  3  -  Color  display  specification,  measurement,  and 
calibration  techniques 

0  Identify,  define,  and  review  primary  color  display  system  visual 
parameters 

-  resolution 

-  linewidth/spot  size 

-  maximum 

-  minimum 

-  video  bandwidth 

-  beam  focus 

-  convergence 

-  luminance  ana  contrast 

-  maximum 

-  minimum 


-  uniform' >7 
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-  Frame/field  refresh  rates 

-  Chromaticity 

-  color  repertoire 

-  color  difference 

-  chromaticity  tolerance 

o  Develop  display  specification  guidelines 

-  Generic  specifications  for  airborne  color  display  system  visual 
parameters 

o  Review  color  display  measurement  issues 

-  Identify  appropriate  measurement  and  calibration  techniques 

o  Subtask  4  -  Unresolved  issues  and  future  color  display  research 
requirements 

o  Identify  major  data  voids  and  their  significance  for  color  display 
system  design 

-  visual/perceptual  factors 

-  color  display  hardware  characteristics 

o  Prioritize  unresolved  issues  in  terms  of  current  needs 
o  Recommend  types  of  future  research  and  structure  of  data  which 
would  most  efficiently  resolve  problems  areas 

As  stated  previously,  the  objectives  of  the  second  task  of  the  initial  phase  of  the  progpram 
are.  concerned  with  the  survey  and  evaluation  of  currently  available  or  proposed  color 
display  systems.  Task  n  has  been  organized  according  to  the  following  three  sub-tasks: 

o  Subtask  i  -  Technical  evaluation  of  hardware  characteristics  and 
visual  parameters 

o  Subtask  2  -  Evaluation  summary  and  specific  recommendations 

0  Subtask  3  -  Prediction  of  future  trends  and  developments  in  color 

display  technology 

A  survey  of  the  state-of-the-art  in  color  CRT  display  systems  which  are  either  available 
or  under  development  was  conducted  from  November  1983  through  April  1984.  Twelve 
companies  which  comprise  a  representative  sampling  of  high  technology  color  CRT 
display  equipment  manufacturers  were  surveyed.  From  these  companies  end  their  inputs 


twenty  systems  have  been  evaluated  and  parametrically  described. 


The  color  CRT  display  systems  evaluated  fall  into  three  general  categories  -  front 
cockpit  color  CRT  displays,  work  station  displays,  and  laboratory  monitors.  Front 
cockpit  displays  are  those  designed  for  intended  use  in  high  ambient  light  environments 
such  as  transport  aircraft  cockpits  (8,000  ft-c  ambient)  end  fighter  aircraft  cockpits  with 
bubble  canopies  (10,000  ft-c  ambient).  Work  station  displays  are  those  designed  for 
controlled  ambient  lighting  environments  such  as  command/control  stations.  Work 
station  displays  are  typically  larger  and  have  significantly  lower  luminance  requirements 
than  front  cockpit  displays.  Laboratory  monitors  are  displays  specifically  designed  for 
use  in  laboratory  environments  and  are  not  intended  for  airborne  applications.  Three 
such  systems  were  surveyed  due  to  their  special  features  such  as  high  bandwidth,  superior 
color  tracking,  or  unique  convergence  methods.  In  order  to  facilitate  comparisons 
between  systems  and  help  identify  common  limitations  of  the  current  technology,  the 
same  basic  set  of  physical,  resolution,  luminance,  and  ehromaticity  parameters  were 
used  to  define  the  visual  performance  characteristics  of  all  surveyed  systems. 

Taken  together,  the  two  tasks  of  program  Phase  I  are  intended  to  provide  a 
comprehensive,  state-of-the-art  overview  of  fundamental  visual,  perceptual,  and  display 
system  considerations  for  airborne  applications  of  color  display  technology.  The 
following  sections  focus  on  a  few  select  issues  of  interest  for  color  display  system  design. 

A  FEW  INTERESTING  ISSUES 

PREDICTIVE  COLOR  MODELING  FOR  SMALL  COLOR  IMAGES 

The  CIE  (1931)  ehromaticity  system  and  diagram,  illustrated  in  Figure  5,  enables  basic 
colorimetric  description  and  manipulation  for  electronic  displays.  However,  the 
prediction  and  optimization  of  effective  color  display  performance  requires  an  analytical 
method  which  characterizes  the  perceptual  interface  between  color  display  and  observer 
(Silverstein  &  Merrifield,  1981).  Complex  multi-color  display  formats,  as  well  as  the 
extreme  dynamic  range  of  ambient  lighting  conditions  in  the  airborne  environment,  pose 
difficult  problems  for  the  prediction  of  color  display  performance.  Existing  analytic 
methods  are  limited  in  their  precision,  for  the  human  visual  systems  is  far  from  being 
solved.  Nevertheless,  the  development  and  continuous  refinement  of  predictive  color 
modeling  techniques  is  necessary  in  order  to  minimize  the  need  for  repetitive  and 
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expensive  color  display  performance  testing.  Predictive  analytical  methods  are  integral 
to  a  number  of  critical  issues  in  the  development  of  color  displays:  color  repertoire 
selection;  assessment  of  the  impact  of  the  operational  environment:  specification  of 
color  production  methods;  color  control  and  tolerance;  and  definition  of  essential 
conditions  for  display  performance  verification  testing. 

Currently,  the  CIE  recommends  the  use  of  CIELUV  for  predicting  the  perceptibility  of 
color  differences  in  cases  where  colored  lights  are  additively  mixed.  The  electronic 
color  display  is  obviously  one  such  case.  CIELUV  consists  of  the  most  recent  (CIE-1976) 
uniform  chromaticity  scale  (UCS)  diagram  with  associated  color  difference  equations 
(CIE  Publication  No.  15-Supplement  2,  1978).  The  1976  UCS  diagram,  shown  in  Figure  6, 
is  basically  a  simple  transformation  of  a  previous  1960  UCS  color  space  in  which  the  v- 
axis  of  the  diagram  has  been  magnified  by  a  factor  of  1.5.  Re-scaling  of  the  v-axis  in  the 
1976  UCS  diagram  corrects  for  underestimated  sensitivity  of  the  violet-green  yellow 
component  of  chromatic  perception.  Figure  7  presents  a  graphic  comparison  of  the  1960 
and  1976  UCS  color  spaces.  An  examination  of  Figfure  8  (adapted  from  Laycock  & 
Viveash,  1972),  reveals  that  the  color  discrimination  elipses  of  MacAdam  and  Stiles  (see 
Wyszecki  &  Stiles,  1967)  become  nearly  circular  and  achieve  a  reasonable  uniformity  in 
the  1978  UCS  color  space,  indicating  an  improvement  in  perceptual  uniformity  over 
previous  attempts  to  derive  a  uniform  color  space. 

In  addition  to  the  1976  UCS  color  space,  CIELUV  contains  a  set  of  color  difference 
equations.  The  total  color  difference  between  two  color  samples,  derived  in  complete 
detail  in  Figures  9  and  10,  is  basically  stated  as  follows: 

AE*  -C(AL*)2  +  (AU*)^  +  (  AV*)^;]^''^, 
where 

L*  =  116  (Y/Yn)^/^  -  16,  Y/Yn  >  0.01, 

U*  =  13  L*  (u’  -  uy, 

V*  =  13  L*  (v’  -  vy, 

u'  =  4X/(X  +  15Y  +  3Z)  or  4x/-2x  +  12y  +  3, 

V'  =  9Y/(X  +  15Y  +  3Z)  or  9y/-2x  +  12y  +  3, 

The  variable  reference  coordinates  (u'^.vy  and  reference  luminance  level  (Yj,)  refer  to 
the  neutral  point  of  the.  three-dimensional  coordinate  system,  and  for  surface-color 
applications  are  typically  taken  to  be  the  characteristics  of  the  surface  illuminant  (i.e.  a 
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white  object-color  stimulus).  By  convention,  the  chromaticity  of  CIE  standard  illuminant 
D65  is  often  used  (u'j^  =  0.1978,  =  0.4684)  with  Yj^  set  equal  to  100.  It  should  be  noted 

that  Yfj  is  actually  a  scaling  or  normalizing  factor,  and  for  surface  applications  Yj^  =  100 
denotes  the  luminance  of  the  maximum  possible  reflectance  of  the  surface  under  the 
illuminant  used  (i.e.  100%).  Recently,  Carter  and  Carter  (1983)  have  raised  the  issue 
concerning  the  appropriate  reference  or  neutral  point  when  CIELUV  is  used  for 
estimating  color  difference  with  self-luminous  sources  such  as  electronic  display  media. 
The  parameters  (u'^,  v'^j)  and  Yj^  have  no  obvious  counterparts  for  self-luminous  sources. 
Moreover,  the  arbitrary  usage  of  Y^^  =  100  will  result  in  an  invariance  in  A  E*  units 
depending  on  the  units  of  luminance  used  in  computing  AE*.  Carter  and  Carter  (1983) 
have  recommended  that  the  1976  UCS  coordinates  of  D65  (u'^  =  0.1978,  =  0.4684)  be 

utilized  as  the  neutral  chromatic  points  and  that  Yjj  should  be  set  to  the  maximum 
possible  luminance  of  the  images  whose  color  difference  (AE*)  is  to  be  estimated.  While 
this  solution  is  not  e/itirely  satisfactory,  it  does  preserve  AE*  scale  invariance  with 
respect  to  the  choice  of  luminance  units  and  provides  an  acceptable  interim 
recommendation.  The  choice  of  appropriate  neutral  reference  values  for  color 
difference  formulations  to  be  used  with  self-luminous  color  displays  will  be  a  priority 
topic  for  a  newly  formed  CIE  committee  on  revised  standards  for  self-luminous  displays 
(personal  communication,  Dr.  J.  J.  Rennilson,  January  20,  1984). 

The  CIELUV  color-difference  equations  have  come  into  relatively  wide-spread  usage  as  a 
a  basic  tool  for  the  design  of  self-luminous  color  displays  (Carter  &  Carter,  1981,  1982, 
1983;  Lippert,  Farley,  Poit,  &:  Snyder,  1983;  Merrrifield,  in  press;  Murch,  Cranford,  Jc 
McManus,  1983;  Silverstein,  in  press;  Snyder,  1982).  Carter  and  Carter  (1981)  have  found 
that  CIELUV  color  difference  is  a  good  predictor  of  visual  search  performance  in  color- 
coded  displays,  and  they  have  developed  a  computer-based  algorithm  for  selecting  sets  of 
high-contrast  colors  using  a  CIELUV  metric  (Carter  &  Carter,  1982).  Laycock  and 
Viveash  (1932)  have  found  that  the  1976  UCS  space  and  CIELUV  color-difference 
equations  provide  the  most  appropriate  foundation  for  color  display  specification  and 
modeling.  Murch  et.  al.  (1983)  noted  that  the  CIELUV  color-difference  formulas  are 
good  predictors  of  color  and  brightness  contrast  for  color  CRT  displays.  Snyder  and  his 
students  (Lippert  et.  al;,  1983;  Post,  Costanza,  &  Lippert,  1982:  Snyder,  1982)  have  come 
to  similar  conclusions,  although  some  non-linearities  and  problems  of  scaling  of  the 
luminance  axis  of  the  CIELUV  model  have  been  discovered.  The  significance  of  such 
anomalies  is  currently  unclear.  While  future  research  will  undoubtedly  bring  refinements 
to  the  CIELUV  model,  including  a  more  optimal  scaling  of  the  luminance  axis,  the  CIE 
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1976  UCS  color  space  and  CIELUV  equations  currently  offer  the  most  empirically  sound 
foundation  of  predicting  effective  color  display  performance. 

A  grapiiie  representation  of  CIELUV  color  difference  within  a  three-dimensional 
rectangular  coordinate  system  is  shown  in  Figure  10.  The  basic  application  of  CIELUV 
for  estimating  color  difference  on  an  electronic  color  display  is  relatively 
straightforward  and  is  illustrated  in  Figure  11. 

While  the  CIELUV  system  is  an  extremely  useful  tool  for  the  display  designer,  the 
accuracy  of  CIELUV  color-difference  predictions  are  still  limited  by  factors  not 
contained  in  the  basic  system.  Two  such  factors  of  major  magnitude  are  color  image 
field  size  and  an  appropriate  spectral  luminosity  function  for  heterochromatic  imciges. 

It  is  a  well-known  fact  of  color  perception  that  the  ability  to  perceive  color  differences 
is  profoundly  influenced  by  the  field  size  of  the  colored  images  to  be  compared  (Burnham 
&  Newhall,  1953;  Burnham,  Hanes,  &  Bartleson,  1963;  Judd  &  Wyszecki,  1963).  In 
general,  small  color  fields  appear  less  saturated  and  sometimes  appear  shifted  in  hue 
relative  to  larger  targets  of  the  same  measured  chromaticity  and  luminance.  The  ability 
to  discriminate  between  colors,  particularly  along  the  blue-yellow  continuum,  is  also 
reduced  for  small  fields.  Since  displayed  image  sizes  for  color  display  systems  will  often 
be  much  smaller  than  the  two  degree  or  ten  degree  standard  observer  data  which  form 
the  basis  of  current  predictive  color  models,  sizeable  errors  in  estimated  color  difference 
can  result  (Silverstein,  in  press;  Silverstein  &  Merrifield,  1981;  Ward,  Greene,  Sc.  Martin, 
1983).  A  considerable  increase  in  precision  for  current  color  models  could  be  achieved  if 
estimates  of  field  size  effects  were  incorporated  into  color  difference  equatioas. 

To  a  large  extent,  symbol  sizes  for  alphanumeric  tmd  graphic  symbols  on  color 
information  displays  will  subtend  less  than  thirty  minutes  of  visual  arc.  Fortunately, 
Judd  and  his  colleagues  (Judd  &  Yonemura,  1969;  Judd  Sc  Eastman,  1971)  have  worked  out 
an  empirically-derived  set  of  small-field  correction  factors  for  the  1964  CIE  (U*,  V*,  W*) 
color-difference  metric,  a  predecessor  of  the  CIELUV  system  which  was  based  on  the 
CIE  1960  UCS  color  space.  The  correction  assumes  three  weighting  factors  k^,  k^,  and 
k^  which  represent  the  relationship  between  field  size  cmgular  subtense  and  the 
sensitivity  of  the  red-green,  violet-green  yellow,  and  light-dark  visual  channels, 
respectively  (Judd  Sc  Yonemura,  1969).  The  dependency  of  each  of  these  factors  on 
angular  subtense  is  shown  in  Figure  12. 
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It  is  important  to  note  that  the  chromatic  weighting  factors,  ky  and  ky,  decrease  rapidly 
with  reductions  in  angular  subtense  compared  to  the  light-dark  factor,  k^,.  This  accords 
well  with  other  visual  data  indicating  a  greater  dependency  between  field  size  and 
chromatic  perception  than  between  field  size  and  brightness  perception.  In  addition,  the 
extremely  rapid  decrement  in  ky  as  angular  subtense  is  decreased  agrees  well  with  the 
phenomenon  of  smell  field  tritanopia,  particularly  severe  losses  in  violet-yeUow 
sensitivity  for  field  sizes  below  about  twenty  arc  minutes  (e.g.,  Farrell  &  Booth,  1975). 

In  order  to  apply  these  correction  factors  to  the  CIELUV  color  space,  it  becomes 
necessary  to  modify  the  violet-yellow  factor,  ky.  Since  the  major  difference  between 
the  1964  CIE  (U*,  V*,  W*)  color  space  and  the  CIELUV  color  space  may  be  found  in  a 
1.5x  expansion  of  the  v-axis  in  the  1976  CIE  UCS  diagram,  it  becomes  necessary  to  divide 
the  violet-yellow  factor,  ky,  by  1.5  to  account  for  the  enhanced  sensitivity  of  the  v-axis 
in  CIELUV.  Figure  13  shows  the  appropriate  smaU-field  correction  factors  (kj^',  ky',  kj^) 
for  the  CIELUV  color  difference  equations. 

A  preliminary  evaluation  of  the  sensitivity  of  the  CIELUV  small  field  correction  factors 
can  be  obtained  by  a  re-analysis  of  the  results  from  a  sot  of  studies  by  Silverstein  and 
Merrifield  (1981).  These  studies  involved  the  specification  and  visual  verification  of 
color  and  luminance  requirements  for  the  shadow-mask  color  CRTs  used  in  the  Boeing 
Model  757/767  aircraft.  The  objective  was  to  develop  an  effective  color  repertoire  for 
use  in  ambient  environments  ranging  from  .1  ft-c  to  8000  ft-c.  Operational  display 
formats  were  to  consist  of  raster  background  fields  up  to  5.5  degrees  of  visual  arc  and 
varied  stroke-written  symbols  of  small  anguleir  subtense.  In  the  initial  step,  a 
preliminary  color  repertoire  was  developed  through  analytical  techniques.  A  computer 
color  model  was  used  to  facilitate  the  attempt  to  maximize  the  perceptual  dispersion 
between  colors,  within  the  constraints  imposed  by  the  display  hardware.  The  initial  color 
set  contained  seven  stroke  colors,  four  of  which  were  also  used  for  the  larger  raster 
fields. 

Visual  testing  to  verify  and/or  modify  the  selected  colors  and  to  determine  luminance 
requirements  wa  j  conducted  in  three  phases.  Pilots  and  engineering  personnel  served  as 
subjects  and  were  all  screened  for  color  vision  deficiencies.  The  visual  task  employed  a 
comparative  forced-choice,  color-naming  task  which  best  represented  the  partially 
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redundant  use  of  color  coding  on  the  operational  flight  displays^.  A  criterion  of  S596 
correct  color  discrimination  for  each  color  was  adopted  as  acceptable. 

In  the  first  test  phase,  raster  chromaticity  and  luminance  requirements  for  5.5  degree 
raster  fields  of  red,  green,  amber  and  cyan  were  determined.  Testing  was  conducted 
under  jimulated  sunlight  viewing  conditions  which  for  the  particular  displays  under 
consideration  was  estimated  at  8000  ft-e.  The  second  test  phase,  also  conducted  under 
8000  ft-c.  of  ambient  illumination,  was  designed  to  determine  chrominance  and 
luminance  requirements  for  seven  stroke-written  symbol  colors.  Diamond-shaped 
symbols  of  approximately  20  minutes  of  visual  arc  were  used  eis  targets  smd  were 
presented  on  either  a  blank  background  or  a  background  consisting  of  one  of  the  raster 
colors  specified  in  the  first  test  phase.  Raster  luminance  was  fixed  at  previously 
determined  levels  and  stroke  symbol  luminance  was  manipi  ed  in  increments  of 
stroke/raster  contrast  ratio.  Figure  14  illustrates  the  locations  of  the  seven  stroke 
colors  in  CIE  1931  coordinates  and  the  directional  shifts  in  chromaticity  due  to  ambient 
illumination  of  the  display.  Figure  15  shows  the  test  pattern  generated  on  the  CRT 
display  as  well  as  a  summary  of  test  conditions.  The  basic  test  results  for  the  second 
test  phase  are  shown  in  Figure  16.  Color  discrimination  performance  increased  up  to  a 
stroke/raster  contrast  ratio  of  approximately  5.0,  but  beyond  that  point  additional 
increments  in  stroke  luminance  offered  no  significant  improvements  in  performance. 
Figure  16  also  reveals  that  criterion  performance  for  the  seven  colors  was  not  reached 
simultaneously.  During  the  last  phase  of  test,  criterion  color  discrimination  performance 
at  a  stroke/raster  contrast  ratio  of  5.0  was  verified  under  low-ambient  viewing 
conditions  (.1  ft-c.) 

A  careful  examination  of  Figure  16  indicates  that  the  colors  magenta,  purple,  cyan,  and 
white  failed  to  achieve  criterion  color  discrmination  performance  at  a  stroke/raster 
contrast  ratio  of  4.0.  Thus,  all  of  the  secondary  display  colors  containing  some  mixture 
of  the  blue  primary  were  the  most  difficult  to  discriminate,  and  this  subset  of  colors  was 
responsible  for  "driving  up"  display  luminance  levels  to  a  stroke/raster  contrast  ratio  of 
5.0.  Beyond  a  stroke/raster  contrast  ratio  of  5,0  all  display  colors  meet  or  exceed  the 


^It  should  be  noted  that  color  is  never  used  as  a  singular  information  code  on  the  757/767 
flight  displays.  Rather,  color  is  always  combined  with  shape  or  positional  coding  of 
symbology  to  produce  a  highly  reliable,  partially  redundant  form  of  information  coding. 


95%  performance  criterion;  however,  a  persistent  pattern  of  errors  (i.e.,  color 
confusions)  occurred  throughout  the  range  of  testing.  Figure  17  shows  the  pattern  of 
color  confusions  found  at  a  stroke/raster  contract  ratio  of  5.0.  It  can  be  seen  that 
disproportionately  higher  errors  occur  between  cyan  and  green,  white  and  amber,  red  and 
magenta,  and  magenta  and  purple.  The  results  of  Figure  16  can  thus  be  explained  by  the 
fact  that  .,3t  subjects  tended  to  confuse  cyan  with  green,  white  with  amber,  magenta 
with  red,  and  purple  with  magenta.  Evidently,  discrimination  between  pairs  of  colors 
which  differ  predominantly  in  the  amount  of  the  blue  primary  component  is  a  difficult 
task  when  the  angular  subtense  of  the  images  is  small.  The  obtained  pattern  of  color 
confusions  is  not  unlike  the  tritanopic  confusion  trends  often  obtained  with  small 
chromatic  images  (Burnham  &  Newhall,  1953). 

In  addition  to  illustrating  color  discrimination  errors.  Figure  17  also  shows  the  pattern  of 
CIELUV  color  difference  predictions  (  AE*)  between  adjacent  test  colors  and  field-size 
corrected  color  difference  estimates  (AE*gf)  computed  using  the  20  arc  minute  size  of 
the  test  symbols.  It  is  apparent  that  the  uncorrected  (AE*)  color  difference  estimates  do 
not  predict  the  obtained  pattern  of  color  discrimination  performance.  However,  by 
application  of  the  field-size  correction  (AE*gf)  the  color  difference  estimates  can  be 
made  to  correspond  to  the  obtained  results  quite  closely. 

The  incorporation  of  a  field-size  correction  factor  into  existing  predictive  color  models 
can  enhance  their  utility  as  a  color  display  design  tool.  Since  many  color  display 
applications  involve  the  presentation  of  small  chromatic  images,  a  more  realistic  and 
uniform  description  of  the  effective  color  performance  of  many  electronic  color  display 
systems  can  be  achieved  by  taking  image  size  into  consideration.  Future  empirical 
research  will  undoubtedly  improve  the  precision  of  analytical  color  models. 


DISCREPANCIES  BETWEEN  MEASURED  LUMINANCE  AND  PERCEIVED  BRIGHTNESS 


FOR  MULTI-COLOR  IMAGES 


Modern  electronic  color  display  systems  are  currently  being  used  for  presentation  of  a 
broad  range  of  information.  Color  coding  can  be  used  to  convey  unique  information, 
increase  information  redundancy,  organize  a  spatially  complex  display,  highlight 
particular  features  of  a  presentation,  and  attract  the  attention  of  a  busy  operator.  In 
some  color  applications,  such  as  the  coding  of  normal-advisory-eaution-warning  schemes, 
it  may  be  desirable  for  simultaneously  displayed  colors  :o  appear  equally  bright  or  in 


some  known  ratio  of  perceived  brightness.  For  many  colors  and  viewing  conditions, 
simple  photometric  luminance  measurements  will  not  satisfy  these  goals. 

Inadequacies  in  the  current  photopie  luminosity  function  V(  x  )  for  estimating  the 
brightness  of  chromatic  sources  have  been  noted  for  years  (CIE  Publication  No.  41,  1 978; 
Kinney,  1983).  Basically,  failures  in  the  relationship  between  luminance  and  subjective 
brightness  for  chromatic  visual  sources  can  be  traced  to  the  fact  that  a  non-additive 
luminous  efficiency  function  describes  the  relative  perceived  brightness  of  simultaneous, 
heterochroma  tic  samples.  Kinney  (1983)  has  pointed  out  that  the  presence  or  absence  of 
additivity  depends  on  the  methods  used  to  obtain  the  luminous  efficiency  functions. 
Further,  the  standard  V(x)  pho topic  sensitivity  curve  was  obtained  by  flicker  photometry, 
which  produces  additive  results,  but  the  appropriate  method  for  assessing  the  brightness 
of  heterochromatic  images  is  heterochromatie  brightness  matching,  which  yields  non¬ 
additive  results.  The  impact  of  this  discrepancy  is  that  the  relative  brightness  of 
narrow-band  chromatic  images  will  be  seriously  underestimated  at  both  short-  and  long- 
wavelengths.  That  is,  blue  and  red  images  will  appear  much  brighter  than  would  be 
predicted  by  their  measured  luminance.  The  differences  between  estimates  of  luminous 
efficiency  provided  by  the  standard  photopic  luminosity  function  V(  x )  present  in  aU 
photometric  measurement  instruments  and  those  obtained  by  heterochromatic  brightness 
matching  are  illustrated  in  Figure  18. 

Since  the  method  of  flicker  photometry  primarily  samples  the  output  of  the  achromatic 
visual  channel,  it  follows  that  the  standard  photopic  luminosity  function  (Vx),  being 
derived  from  this  method,  will  yield  luminance  values  which  are  most  representative  of 
the  brightness  of  achromatic  or  low  purity  sources  (CIE  Publication  41,  1978).  Thus, 
achromatic  sources  will  appear  equally  bright  when  their  luminances  are  equivalent  as 
will  colors  of  equal  luminance  which  are  close  in  wavelength.  However,  two  highly 
saturated  colors  relatively  far  apart  in  wavelength  and  equal  in  luminance  will  rarely 
appear  equally  bright.  The  degree  of  chromaticness  of  a  stimulus  affects  perceived 
brightness,  and  the  perceived  brightness  of  colors  of  high  purity  will  depart  more  from 
measured  luminance  than  colors  of  low  purity.  This  relationship  is  illustrated  in  Figure 
19  (from  Kinney,  1983),  in  which  spectral  luminous  efficiency  is  plotted  as  a  function  of 
color  purity.  The  lowest  curve  represents  V(  x),  and  it  can  be  seen  that  as  color  purity  is 
decreased  or  approaches  neutrality  (achromatic)  the  spectral  luminous  efficiency 
function  comes  progressively  closer  to  matching  V(x),  i.e.  measured  luminance. 


Kinney  (1983)  has  indicated  that  CIE  Technical  Committee  1.4  is  presently  working  on 
new  photometric  standards  which  will  be  more  applicable  to  self-luminous  displays  under 
a  wide  range  of  viewing  conditions.  To  date,  no  new  standard  or  replacement  to  the 
familiar  V  ( x )  curve  has  been  presented.  However,  two  temporary  solutions  have  been 
proposed  for  estimating  the  relative  brightness  of  heterochromatic  sources.  Kinney 
(1983)  has  offered  an  interim  solution  for  monochromatic  or  high-purity  self-luminous 
sources  which  consists  of  a  brightness/luminance  (B/L)  weighting  function  for 
wavelengths  betweeen  400-730  nanometers.  Figure  20  contains  tabled  values  of  spectral 
luminous  efficiency  determined  by  heterochromatic  brightness  matching  and  computed 
ratios  between  these  values  and  V(  X )  luminance  weighting  factors  (B/L).  It  can  be  seen 
that  these  ratios  become  quite  large  at  the  ends  of  the  spectrum.  Kinney  (1983)  has 
recommended  that  the  B/L  ratios  be  used  only  for  monochromatic  or  narrow-band 
sources.  Thus,  they  should  work  reasonably  well  for  such  notably  narrow-band  self- 
luminous  display  media  as  light  emitting  diodes  (LEDs),  but  it  is  questionnable  whether 
color  CRT  phosphors  represent  a  sufficiently  pure  self-luminous  source  for  the  B/L  ratios 
of  Kinney  (1983)  to  apply.  While  P22  red  and  P22  blue  phosphors  in  particular  may 
achieve  high  values  of  excitation  purity  under  low-ambient  lighting  conditions,  P22  or 
P43  green  primary  phosphors  are  much  less  saturated  and  all  CRT  colors  will  undergo 
substantial  redi-ctions  in  excitation  purity  under  the  high-ambient  lighting  conditions 
found  in  the  airborne  operating  environment  (Merrifield,  in  press;  Silverstein,  in  press; 
Silverstein  &  Merrifield,  1981). 

Another  interim  solution  recently  proposed  by  Ware  and  Cowan  (1983)  has  been  submitted 
to  the  CIE  for  consideration  as  a  provisional  recommendation.  In  this  approach,  a 
luminance  to  brightness  conversion  is  derived  by  finding  the  best  fitting  polynomial 
function  relating  the  logarithm  of  B/L  ratios  taken  from  heterochromatic  brightness 
matching  data  to  CIE  (1931)  chromaticity  coordinates  (x,  y).  Since  this  approach  is  based 
upon  chromaticity  coordinates  rather  than  wavelength,  it  may  be  used  to  estimate  the 
relative  brightness  of  chromatic  sources  which  are  not  monochromatic  or  spectrally 
pure.  Ware  and  Cowan  (1983)  have  cautioned  that  their  correction  does  not  yield 
anything  which  relates  to  the  absolute  experience  of  brightness.  Rather,  its  utility  lies  in 
the  determination  of  the  relative  brightness  of  heterochromatic  stimuli. 
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The  solution  proposed  by  Ware  and  Cowan  (1983)  has  several  important  advantages:  (1)  \ 

the  solution  was  determined  statistically  by  finding  the  best-fitting  polynomial 
expresssion  for  a  large  data  base  of  results  from  heterochromatic  brightness-matching  .  .  ] 
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studies;  (2)  inputs  to  the  solution  are  commonly  used  colorimetric  and  photometric 
quantities;  and  (3)  unlike  other  proposed  solutions  (e.g.,  Kinney,  1983),  the  luminance  to 
brightness  correction  may  be  estimated  for  chromatic  sources  which  are  not 
monochromatic  or  of  very  high  excitation  purity.  This  latter  point  is  especially  relevant 
to  airborne  applications  since  color  displays  operated  within  a  variable  range  of 
illumination  tend  to  be  high  purity  chromatic  sources  at  low  illumination  levels  and  low- 
purity  chromatic  sources  at  high  illumination  levels.  In  addition,  as  Kinney  (1983)  has 
pointed  out  and  Ware  and  Cowan  (1983)  have  effectively  demonstrated  with  their 
correction  factor  (see  Figure  21),  the  discrepancies  between  luminance  and  perceived 
brightness  decrease  as  excitation  purity  decreases.  The  perceived  brightness  of 
chromatic  sources  of  low  excitation  purity,  such  as  color  CRT  phosphors  desaturated  by 
high  ambient  illumination,  is  reasonably  well  estimated  by  the  photopic  luminosity 
function  (i.e.,  measured  luminance). 

Ware  and  Cowan's  (1983)  solution  contains  a  polynomial  correction  factor  and  a 
brightness  estimation  formula  which  includes  the  correction  factor  as  a  term.  The 
correction  factor  and  brightness  formula  ere  described  in  Figure  22  and  have  been  used 
to  calculate  estimated  equal  brightness  values  for  the  primaries  of  a  particular  shadow- 
mask  color  CRT,  These  calculations  are  illustrated  in  Figure  23.  It  can  be  see  that  for 
this  particular  display  (under  conditions  of  low  ambient  illumination)  only  20.2  Ft-L  of 
red  and  15.8  Ft-L  of  blue  are  required  to  approximately  match  the  apparent  brightness  of 
30  Ft-L  of  the  green  system  primary.  These  estimated  luminance  levels  for  equal 
perceived  brightness  are  in  reasonable  accord  with  the  results  of  a  recent 
heterochromatic  brightness  matching  study  which  used  a  shadow-mask  color  CRT  display 
with  P22  phosphors  (Murch  et,  al.  1983),  and  also  are  in  good  agreement  with  our  own 
observations  of  many  color  displays  viewed  in  low-ambient  settings.  Under  conditions  of 
high  ambient  illumination,  reductions  in  excitation  purity  of  display  colors  shift  the 
chromaticity  coordinates  of  the  colors  toward  a  neutral  point,  and  the  resulting 
luminance  to  brightness  estimates  tend  toward  unity. 

AUTOMATIC  BRIGHTNESS/CONTRAST  COMPENSATION  SYSTEMS  FOR  DYNAMIC 
AMBIENT  LIGHTING  ENVIRONMENTS 

Airborne  color  display  systems  for  cockpit  applications  must  be  capable  of  providing 
suitable  chromatic  differentiation  and  image  brightness  over  a  broad  dynamic  range  of 
ambient  illumination.  In  addition,  cockpit  displays  must  also  be  able  to  accommodate 


transient  changes  in  the  state  of  adaptation  of  the  pilot's  eyes.  A  condition  of  "eye 
adaptation  mismatch"  can  occur  when  the  eyes  are  adapted  to  a  surround  luminance 
much  higher  than  that  of  the  display  or  when  the  eyes  sequentially  alternate  between  a 
high-luminance  outside  view  and  relatively  low-luminance  display.  Ambient  illumination 
incident  upon  the  surface  of  a  panel-mounted  display  may  be  expected  to  range  from 
approximately  .1  to  8,000  ft-C  in  the  enclosed  flight  deck  of  a  large  transport  aircraft 
such  as  the  Boeing  767  (Silverstein  A:  Merrifield,  1981),  while  the  range  of  incident 
ambient  illumination  is  extended  from  approximately  .1  to  10,000  ft-C  for  aircraft  with 
high  transmissibility  bubble  canopies  (Rogers  &  Poplawski,  1973;  Semple,  Heapy,  Conway, 
A  Burnette,  1971).  The  range  of  forward-field-of-view  (FFOV)  adapting  luminances  is 
similar  for  the  two  environments  and  can  be  expected  to  range  from  approximately  .0001 
to  10,000  Ft-L  (Rogers  A  Poplawski,  1973;  Semple  et.  al.,  1971). 

In  order  to  minimize  the  need  for  frequent  manual  adjustments  of  display  luminance 
during  dynamic  changes  in  cockpit  ambient  illumination  and  FFOV  luminance,  some  form 
of  automatic  compensation  control  must  be  incorporated  into  the  display  system. 
Historically,  automatic  brightness  control  systems  have  often  been  implemented  by 
changing  the  display  luminance  as  a  function  of  the  input  from  a  panel-mounted  light 
sensor  in  such  a  way  that  the  contrast  between  emitted  display  luminance  and  display 
background  luminance  remains  constant.  This  simplistic  constant-contrast  type  of 
automatic  control  has  not  proven  effective  for  two  reasons:  1)  display  contrast 
requirements  change  dramatically  as  a  function  display  background  luminance  (i.e.  an 
observer's  contrast  sensitivity  increases  as  background  luminance  increases  -  relatively 
high  contrast  is  required  at  low  levels  of  display  background  luminance  while  relatively 
low  contrast  is  required  at  high  levels  of  background  luminance);  and  2)  the  symbol-to- 
background  contrast  required  for  comfortable  display  readability  varies  for  different  eye 
adaptation  levels.  Failure  to  incorporate  an  automatic  brightness  control  system  or 
implementation  of  an  inappropriate  system  often  causes  operators  to  drive  the  displays 
to  a  higher  luminance  level  than  required.  This  strategy  minimizes  the  need  for 
"nuisance"  brightness  adjustments  during  high-workload  operations.  Unfortunately,  it 
also  results  in  a  reduction  of  the  operational  life  of  the  display. 

Recognizing  the  need  for  an  effective  automatic  brightness  control  system,  Boeing 
initiated  a  study  program  during  the  development  of  the  757/767  color  display  systems 
which  concluded  that  three  types  of  brightness  control  were  required: 
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1)  A  manual  brightness  control  to  accommodate  individual  differences  in  the 
visual  sensitivity  of  pilots  as  well  as  the  use  of  sunglasses. 

2)  Automatic  brightness  compensation  which  changes  the  display  luminance  as  a 
function  of  changing  ambient  light  levels  incident  on  the  display  (as  detected 
by  an  internal  light  sensor  integral  to  each  display). 

3)  Automatic  contrast  compensation  which  changes  the  display  symbol-to- 
background  contrast  as  a  function  of  changing  luminance  levels  in  the  pilot's 
FFOV  (as  detected  by  a  remote,  forward  facing  light  sensor) 

In  order  to  determine  the  appropriate  functions  f.'ir  each  type  of  control  and  the  method 
for  integrating  the  functions  into  a  single,  adaptive  brightness  control  system,  visual 
testing  was  conducted  in  an  ambient  light  simulator  which  approximated  the  viewing 
geometry  of  the  Boeing  767  flight  deck.  A  diagram  of  this  apparatus  is  shown  in  Figure 
24.  Fourteen  test  subjects  were  each  exposed  to  a  series  of  parametric  combinations  of 
intensity  of  incident  ambient  illumination  and  FFOV  luminance.  The  experimental  task 
consisted  of  alternating  periods  of  monitoring  the  FFOV  and  test  display,  during  which 
time  subjects  adjusted  display  luminance  to  provide  comfortable  viewing  and  display 
readability.  The  test  display  was  an  engineering  prototype  shadow-mask  color  CRT.  A 
complex  EADI  format,  which  included  all  display  colors,  was  continuously  presented  on 
the  test  display. 

The  results  of  this  investigation  can  be  expressed  by  two  functions:  one  function  relates 
reflected  display  background  luminance  produced  by  incident  ambient  illumination  (total 
display  reflectance  =  approximately  1.25%)  to  subject-selected  levels  of  emitted  display 
luminance  while  a  second  function  describes  the  obtained  relationship  between  the  ratio 
of  FFOV  intensity  to  display  white  stroke  intensity  and  a  contrast  multiple  or  gain  factor 
determined  from  subjects  manual  brightness  selection. 

The  first  function,  which  relates  display  background  luminance  to  emitted  symbol 
luminance,  is  shown  in  Figure  25.  Only  the  results  for  the  colors  white,  green,  and  red 
are  plotted  since  the  functions  for  all  colors  were  determined  by  a  single  brightness 
control.  The  relationship  is  described  by  a  power  function  which  becomes  linear  in 
logarithmic  coordinates.  The  curve  shown  for  the  monochromatic  CRT  is  adapted  from  a 
study  by  Knowles  and  Wulfeck  (1972)  which  examined  luminance  and  contrast 


requirements  for  several  high-contrast  monochromatic  CRTs.  While  the  slopes  of  the 
functions  for  the  color  and  monochromatic  displays  differ  somewhat,  they  arc  both 
described  by  power  functions,  are  in  good  agreement  with  the  basic  vision  literature  on 
brightness  perception  and  brightness  discrimination  (Blackwell,  1946;  Brown  &  Mueller, 
1965;  Graham,  1965),  and  depart  significantly  from  a  constant-contrast  function.  In 
addition,  the  data  from  the  previously  described  study  on  small  symbol  visibility  and 
color  discrimination  are  plotted  for  comparison  purposes,  since  it  has  generally  been 
found  that  observers  select  higher  display  luminance  levels  for  comfortable  viewing  than 
are  actually  required  for  minimum  visual  performance  (Knowles  Sc  Wulieck,  1972).  This 
last  issue  provides  some  rationale  for  the  argument  that  an  effective  automatic 
brightness  control  can  help  prolong  display  life  by  minimizing  excessive  manually- 
selected  levels  of  display  luminance. 

The  second  function,  which  describes  the  relationship  between  the  ratio  of  FFOV 
luminance  to  display  peak  intensity  (i.e.,  white  stroke  intensity)  and  a  contrast  multiple 
or  gain  factor,  is  illustrated  in  Figure  26.  This  contrast  multiple,  in  effect,  compensates 
for  conditions  of  transient  adaptation  or  eye  adaptation  mismatch.  From  Figure  26,  it  is 
apparent  that  the  obtained  test  results  quite  closely  approximate  the  previously 
established  correction  function  for  monochromatic  displays  (see  inset  of  Figure  26; 
adapted  from  Burnette,  1972),  at  least  for  the  higher  ratios  of  mis-adaptation.  The  test 
results  for  the  color  display  dictated  the  necessity  for  an  adapted  gain  function,  which 
consists  of  a  single-slope  function  following  the  high-ratio  segment  of  the  previously 
established  monochromatic  correction  function  but  reaching  a  contrast  multiple  of  unity 
at  a  FFOV/peak  display  intensity  ratio  of  4.2.  The  discrepancies  between  the  low-ratio 
segments  of  present  and  previous  correction  functions  may  be  explained  by  the  fact  that 
the  denominators  of  the  ratios  which  determine  the  two  functions  differ.  Display  white 
stroke  intensity  will  always  be  higher  than,  but  proportional  to,  display  background 
luminance  for  a  display  with  an  acceptable  level  of  contrast. 

Figure  27  shows  a  functional  block  diagram  of  an  automatic  brightness/contrast 
compensation  system  which  incorporates  the  functions  derived  from  empirical  vision 
testing  with  a  prototype  color  display.  In  addition  to  the  implementation  of  these  basic 
functions,  the  system  incorporates  a  manual  brightness  control  with  a  logarithmic 
characteristic  and  separate  time  constants  for  commanded  display  brightness  increments 
and  decrements.  A  logarithmic  manual  control  is  required  since  greater  adjustment 
serisitivity  is  needed  at  low  brightness  levels  than  at  higher  levels.  The  time  constants 
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smooth  the  system  response  and  tailor  display  brightness  transitions  to  approximate  the 
time  course  of  changing  visual  sensitivity  and  instantaneous  operational  contrast 
requirements.  Thus,  a  short  time  constant  is  required  for  brightness  increments  (e.g.  1 
second)  while  a  relatively  long  time  constant  (e.g.  60  seconds)  is  required  for  brightness 
decrements.  The  t'me  constants  do  not  filter  the  action  of  manual  brightness 
adjustments. 

Figure  28  reveals  the  response  characteristics  of  the  automatic  compensation  system. 
The  manual  brightness  control  serves  to  set  the  "bias"  on  the  system  according  to  an 
individual  operator's  visual  sensitivity  and  can  also  compensate  for  the  use  of  sunglasses 
or  sun  visors.  Once  the  system  "bias"  is  set,  the  control  functions  are  designed  to 
maintain  adequate  display  brightness  and  contrast  across  a  broad  range  of  illumination 
and  adaptation  conditions  without  the  need  for  further  manual  adjustment.  Under  very 
low  ambient  conditions,  when  the  display  operator  is  undergoing  continuous  dark 
adaptation,  small  manual  adjustments  in  display  brightness  are  generally  required. 

An  automatic  brightness/contrast  compensation  system  conforming  to  the  basic 
characteristics  discussed  in  this  paper  has  received  extensive  operational  valication 
during  both  flight  test  and  line  service  of  the  Boeing  Model  757/767  aircraft. 

Airborne  color  display  systems  are  being  considered  for  a  variety  of  cockpit  applications 
in  military  aircraft.  Effective  automatic  brightness/contrast  compensation  systems  will 
be  required  to  maintain  acceptable  chromatic  differentiation  and  image  brightness 
without  the  penalty  of  frequent  manual  display  brightness  adjustments  during  high- 
workload  operations.  Refinements  and  modifications  of  the  automatic  compensation 
system  described  in  this  paper  will  undoubtedly  be  necessary  to  meet  the  diverse 
requirements  of  varied  cockpit  environments  and  color  display  applications. 
Nevertheless,  the  basic  system  architecture  and  validated  control  functions  provide  a 
model  for  the  design  of  future  airborne  color  displays. 

OVERVIEW  AND  CONCLUSIONS 

The  successful  development  and  integration  of  fuU-color,  shadow-mask  display 
technology  in  commercial  and  general  aviation  aircraft  have  prompted  a  resurgence  of 
interest  in  airborne  military  applications.  Military  color  display  systems  for  both  cockpit 
and  command/control  applications  are  now  on  the  horizon.  In  the  future,  it  appears 
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likely  that  color  display  technology  will  be  a  part  of  most  new  developments  in  manned 
airborne  systems. 

Color  offers  the  potential  for  greatly  increasing  information  coding  flexibility  and 
capability,  and  for  reducing  visual  search  time  on  highly-dense  complex  displays.  This 
increased  flexibility  and  capability  will  in  turn  enable  the  development  of  more 
integrated  and  veridical  forms  of  information  display.  However,  the  translation  of  color 
capability  into  an  operational  performance  advantage  is  both  system  and  task  specific. 
The  color  coding  of  displayed  information,  when  applied  correctly  and  systematically, 
offer  the  greatest  potential  for  enhancing  operator  performance  in  complex,  high- 
workload  situations  and  in  severe,  dynamic  operational  environments.  These  conditions 
impose  stringent  requirements  on  the  design  of  both  the  color  display  system  and  human 
operator  tasks. 

The  ultimate  goal  of  all  advanced  color  display  development  programs  is  increased 
system  effectiveness  via  enhanced  performance  of  the  human  operator.  While  it  is  easy 
to  state  a  goal  of  increased  system  effectiveness,  defining  the  necessary  steps  to  achieve 
that  goal  or  the  methods  to  evaluate  the  success  of  a  particular  color  display  application 
are  difficult.  Advances  in  color  display  technology  have  been  rapid  and  are  sure  to 
continue.  Our  knowledge  of  how  the  human  operator  perceives,  processes  and  operates 
on  color-coded  information  has  improved  accordingly.  The  development  and  evaluation 
of  effective  color  display  systems  must  be  based  upon  an  integrated  approach  which 
accounts  for  both  human  operator  characteristics  and  color  display  system 
characteristics. 

A  coherent,  unified  body  of  knowledge  which  dictates  a  generic  color  display  design 
strategy  or  leads  to  meaningful  design  guidelines  does  not  yet  exist.  Moreover,  the  goal 
of  increased  aircrew  system  effectiveness  via  enhanced  operator  performance  requires  a 
carefully  planned  strategic  program  of  color  display  design,  implementation,  and 
evaluation.  In  recognition  of  these  current  needs,  the  Systems  Engineering  Test 
Directorate  of  the  Naval  Air  Test  Center,  in  cooperation  with  the  Federal  Aviation 
Administration,  has  recently  initiated  a  systematic  program  for  the  development  and 
evaluation  of  airborne  color  display  systems. 
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Figure  3*  Current  Program  Plan  for  NATO  Sponsored  Color 
Display  Development  and  Evaluation  Activities 
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Figure  4.  Hierarchical  Human  Factors  Analysis  for  Color  Display 
Systems  (from  Silverstein,  in  press)  in  Relation  to  Current 
Program  Plan 


figure  5.  The  Basic  CIE  (1931)  Chromaticity  Diagram 
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Figure  6.  CIE  (1976)  UCS  Diagram  and  Acsoc 
Conversion  from  the  1931  (x,  y)  System 
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Figure  7.  A  Comparison  of  the  CIE  (1960)  and  CIE  (1976) 
UCS  Diagrams 
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Figure  8.  CIE  (1976)  UCS  Diagram  Showing  Discrimination  Ellipses 
Derived  from  Both  MacAdam's  Empirically  Derived  Color  Matching 
Standard  Deviations  and  Stiles'  Line  Element  Predictions  (adapted 
from  Lavcock  &  Viveash,  1982) 
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Figure  9.  Derivation  of  CIE  (L*,  U*,  V*)  Coordinates 
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Figure  10.  Three-dimensional  Representation  of  CIELUV  Color 
Difference  Estimates  (from  Merrifield,  in  press) 


Figure  11.  Application  of  CIELUV  for  Estimating  Color  Difference 
on  an  Electronic  Color  Display  (from  Merrifleld,  in  press) 
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Figure  12.  The  Variation  of  Red-Creen  Factor,  K  ,  Violet-Green 
Yellow  Factor,  K  ,  and  Light-Dark  Factor,  K  ,  with  Angular 
Subtense  of  SmalY  Colored  Targets  for  the  CTE  i96A  (U*,  V*=,  W*) 
Color  Space  (from  Judd  &  Yonemura,  1969) 
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Figure  15.  Color  Test  Pattern  and  Summary  of  Experimental  Test 
Conditions  for  Visual  Verification  Testing  of  Shadow-Mask  Color 
D.isplay  (after  Silverstein  &  Merrifield,  1981) 
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Figure  16.  Stroke-Written  Color  Discrimination  Performance 
(Averaged  Across  Color  Raster  and  Reflected  Ambient  Backgrounds) 
as  a  Function  of  Stroke/Raster  Contrast  Ratio  (adapted  from 
Silverstein  &  Merrifield,  1981) 
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Figure  17,  Color  Confuslon/Color  Difference  Matrix  for  Small  Stroke-Written 
Symbols  Viewed  Under  High-Ambient  Illumination  (from  Silverstcin  &  Merrifield 
1981),  CIELUV  Color  Difference  Computations  are  Shown  for  Both  Uncorrected 
(AE*)  and  Small-Field  Corrected  (AE*gp)  Estimates 
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Figure  18.  A  Comparison  of  CIE  V(X)  (•)  and  CIE  TC-l,4's  (o)  Newest 
Assessment  of  Spectral  Luminous  Efficiency  Obtained  by  Heterochromatic 
Brightness  Matching  (from  Kinney,  1983) 
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Figure  20,  Tabled  Values  of  Spectral  Luminous  Efficiency  for 
CIE  V^X)  and  as  Determined  by  Heterochroma tic  Brightness  Matching 
(V(X)  ).  The  Ratio  V(X)+/V(X)  Provides  an  Estimated  Brlghtness- 
to-Lumlnance  (B/L)  Conversion  for  each  Wavelength  Step  (from 
Kinney,  1983) 
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Figure  21.  Equal  Brightness-to-Luminance  Contours  for  the 
CIE  1931  Chromatic ity  Diagram  Calculated  from  the  Luminance 
to  Brightness  Correction  of  Ware  and  Cowan  (from  Ware  and 
Cowan,  1983) 


Luminance  to  Brightness  Correction  (Ware  and  Cowan,  1983) 

Correction  Factor  (Cj)  =  0.256  -  0.184ys  -  2.527x3yg  +  4.656x|y3  +  4.657x8y§ 
where  x,y  =  CIE  1931  chromaticity  coordinates  of  color  sample 

Brightness  Estimate  -  log  (Bs)  =  log  (Ls)  +  Cs 
where  Ls  =  Luminance  of  sample 

Cs  Computed  correction  factor  for  sample 


Figure  22.  Correction  Factor  and  Brightness  Estimate  Computations 
Derived  by  Wdre  and  Cowan  (1983) 
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Estimated  Equal  Brightness  Values 
for  Shadow-Mask  Color  CRT  Primaries 
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Figure  23 »  An  Application  of  the  Solution  of  Ware  and  Cowan  (1983) 


Figure  24.  Ambient  Light  Simulator  Used  for  Empirical 
Investigation  of  Automatic  Brightness/Contrast 
Compensation  System  Control  Functions 
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Figure  25,  The  Relationship  Between  Observer-Selected  Emitted 
Symbol  Luminance  and  Display  Background  Luminance  for  both 
Color  and  Monochromatic  CRT  Displays  (from  Silverstein,  in 
press;  Monochromatic  Data  Adapted  from  Knowles  &  Wulfeck  (1972)) 
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Figure  26.  Derivation  of  Correction  Factor  for  Eye  Adaptation 
Mismatch-Transient  Adaptation  (Inset  Adapted  from  Burnette,  1972) 
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Figure  27.  Functional  Block  Diagram  of  Automatic  Display  Brightness/ 
Contrast  Compensation  System  for  Dynamic  Ambient  Environments 
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Figure  28.  Automatic  Brightness/Contrast  Compensation  System 
Response  Characteristics 
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Introduction 

Richard  A.  Chorley  presented  a  paper  at  the  5th  Aircrew 
Display  Symposium  in  September  1981  entitled  "Airborne 
Electronic  Color  Displays".  During  this  presentation, 

Dick  Chorley  described  the  work  which  had  been  going  on 
in  the  United  Kingdom,  under  the  aegis  of  the  Department 
of  Industry,  and  which,  after  many  hours  of  simulator 
studies  at  the  Weybridge  facility  of  British  Aerospace, 
had  resulted  in  a  color  display  system  being  installed  in 
a  BAG  1-11  research  aircraft,  of  the  Royal  Aircraft 
Establishment  at  Bedford,  to  provide  an  airborne  assessment 
of  the  potential  of  such  a  system  in  transport  aircraft. 

The  purpose  of  this  paper  is  to  outline  the  results  of 
this  airborne  assessment  and  to  indicate  the  extent  of 
additional  work  which  has  been  carried  out  in  the  UK  over 
the  last  2*5  years. 


Background 


It  is  appropriate  to  describe  briefly  how  the  BAG  1-11 
colour  display  system  was  configured  and  why. 


Located  side  by  side  in  the  1st  Pilot's  instrument  panel 
were  two  large  format  shadow  mask  colour  CRT  display  units 
conforming  to  ARINC  Form  Factor  D.  (Fig.  1)  With  an 
exterior  cross-section  of  8  inches  x  8  inches,  the  Type  D 
unit  provides  a  usable  display  area  of  about  6>s  inches  x 
6h  inches.  There  are  no  peripheral  control  buttons  or 
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switches  on  the  bezel,  separate  controls  on  the  BAG  l-ll 
being  mounted  on  the  panel  immediately  above  the  displays. 
The  side-by-side  arrangement,  with  one  unit  more  or  less 
on  the  pilot's  centre-line,  was  chosen  to  avoid  obscuration 
by  the  control  yoke  which  would  have  occurred  if  the  units 
had  been  mounted  one  over  the  other . 

Prior  to  the  experimental  work  carried  out  in  the  Weybridge 
simulator,  doubts  had  been  expressed  as  to  the  acceptability 
of  this  side-by-side  configuration  but  the  majority  of 
critics  had  not  realised  an  essential  feature  of  these  two 
units.  They  were  not,  it  should  be  stressed,  an  electronic 
ADI  and  an  electronic  HSI  respectively.  The  unit  in 
front  of  the  pilot  was  a  Primary  Flight  Display  (PFD)  and 
that  inboard  was  a  Navigation  Display  (ND).  Experience  in 
the  aircraft  confirmed  that  the  side-by-side  configuration 
was  entirely  acceptable. 

The  PFD  provided  all  the  information,  presented  in  the 
same  relative  position,  that  is  provided  by  the  conventional 
T  pattern  of  traditional  electromechanical  instruments. 

(Fig.  2) 

The  ND  provided  a  traditional  compass  rose  format  if 
desired  (Fig.  3)  but,  to  maximise  the  flexibility  of  the 
CRT  display  in  conjunction  with  the  RNAV  capability  of 
the  aircraft,  the  alternative  format  of  the  map  (or  chart) 
mode  was  provided,  (Fig.  4)  Whichever  format  was 
selected,  additional  navigational  information  was  provided 
in  the  side  frames  -  information  such  as  GMT,  distance-  and 
time-to-go  to  next  waypoint,  true  airspeed  and  so  on. 

Objectives 

There  were  3  objectives  in  the  BAG  1-11  research  exercise: 

(a)  To  examine  the  problems  of  installing  and  interfacing 
this  type  of  display  in  the  environment  of  the  civil 
flight  deck. 
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(b)  To  demonstrate  the  use  of  color  displays  in  their 
working  environment. 

(c)  To  make  a  direct  comparison  between  the  color  displays 
and  conventional  electromechanical  instruments  - 
which  were  retained  on  the  2nd  pilot's  panel. 

This  paper  will  make  no  further  reference  to  the  first  of 
these  objectives. 

Flight  Experience  With  Color  Displays 

After  an  initial  60  or  so  flight  hours  spent  on  assessing 
the  effectiveness  of  two  monochrome  displays,  over  400 
hours  were  flown  with  the  full  color  versions.  The  views 
of  mote  than  150  pilots  who  were  able  to  see  the  color 
system  working  in  flight  -  in  the  UK,  Europe  and  the  USA  - 
contributed  to  the  overall  assessment. 

General  Color  vs.  Monochrome  Impressions 

Limited  subjective  impressions  of  the  monochorme  displays 
were  favorable  but  recordings  of  pilot  performance  when 
flying  manual  ILS  approaches  revealed  little  difference 
between  these  flown  with  this  type  of  display  and  those 
flown  with  conventional  instruments.  (There  was  no  map 
format  provided  with  the  monochrome  version  of  the  ND . ) 
(Fig.  5)  Moreover,  the  uniformity  of  the  monochrome 
presentation,  combined  with  the  small  size  of  the  analog 
scales  on  the  PFD,  was  found  to  give  a  less  effective 
indication  of  some  flight  information.  A  case  in  point 
was  an  occasional  confusion  between  which  was  the  ASI  and 
which  the  altimeter  -  despite  the  fact  that  they  were 
positioned  in  their  conventional  places  in  the  basic  T. 

The  screen  area  on  the  monochrome  displays  was  smaller 
(approximately  6h  inches  x  5  inches)  than  that  on  the 
subsequent  full  color  units  and  this  limited  the  scale 


sizes.  Moreover,  there  was  no  heading  scale  on  the  monochrome 
PFD  -  a  f=\ct  which  had  a  direct  influence  on  the  initial 
criticism  of  the  side-by-side  installation  in  the  early 
simulator  experiments. 

The  addition  of  color  (together  with  the  provision  of  the 
larger  CRT  area  in  each  unit)  overcame  the  earlier 
criticisms  of  the  monochrome  displays,  but  most  significantly 
provided  more  information  in  a  more  compact  scan  pattern 
than  is  possible  using  either  monochrome  CRT  displays  or 
conventional  instruments.  This-  is  directly  attributable 
to  the  improved  symbol  definition  and  discrimination  which 
results  from  the  use  of  color.  The  additional  symbology 
on  the  PFD  gives  the  pilot  an  improved  monitoring 
capability  and  the  selective  presentation  of  relevant  data 
prevents  display  clutter.  The  map  mode  on  the  ND  used 
in  conjunction  with  an  area  navigation  system  significantly 
reduces  pilot  workload  since  together  they  give: 

(a)  An  instant  pictorial  presentation  of  the  current 
situation . 

(b)  No  requirement  for  manual  selection  of  aids. 

(c)  No  requirement  for  mental  interpretation  of 
navigational  beacon  ranges  and  bearings. 


Scan 

As  already  mentioned,  the  monochrome  PFD  had  no  heading 
scale  and  it  had  been  difficult  to  bring  the  ND  heading 
scale  into  the  scan  pattern.  The  scan  distance  to  the 
heading  scale  was  not  great  but  was  considerably  further 
than  that  for  other  flight  information  on  the  PFD.  This 
tends  to  confirm  that  a  balance  of  distance  is  just  as 
significant  as  total  scan  distance. 

This  aspect  of  scan  did  not  generally  arise  with  the  larger 
Type  D  color  displays,  but  the  problem  may  be  difficult 
to  resolve  on  aircraft  equipped  with  a  number  of  smaller 
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CRT  displays  or  those  where  the  pilot  scan  has  to  include 
a  combination  of  CRT  displays  and  electromechanical 
instruments.  Additionally,  the  type  of  eye  stimulus  from 
CRT  displays  and  from  conventional  reflective  instruments 
was  found  to  be  different  with  wide  variations  under 
changing  light  conditions. 

The  combination  of  these  factors  undoubtedly  requires  some 
pilot  adaptation  when  a  mix  of  CRT  and  conventional  displays 
is  provided  and  serious  criticism  was  anticipated.  This 
type  of  mixed  instrumentation  has  of  course  now  entered 
airline  and  general  aviation  service  since  the  BAC  1-11 
assessment  and  the  absence  of  criticism  indicates  that 
there  is  no  serious  problem  associated  with  the  use  of 
mixed  displays. 

Format 

It  is  inevitable  that  pilots  should  have  differing  views 
on  display  formats.  Many  pilots  expressed  surprise  that 
the  BAC  1-11  displays  were  so  conventional.  It  had  never 
in  fact  been  claimed  that  the  display  formats  represented 
an  optimized  solution.  The  PFD  format  in  particular  had 
been  adopted  because  it  provided  information  in  a  manner 
essentially  familiar  to  pilots  trained  on  conventional 
instruments  and  permitted  random  pilot  assessment  of  the 
concept  of  using  CRTs  for  the  display  of  primary  flight 
data.  It  was  in  turn  surprising  to  learn  that  so  many  of 
these  "random  pilots"  were  clearly  familiar  with  some  of 
the  more  advanced  display  concepts. 

There  was  a  consensus  on  the  following  features  of  CRT  ■*" 
displays : 

(a)  The  side-by-side  arrangement  of  the  PFD  and  ND  was 
acceptable  provided  that  all  the  primary  flight 
information  was  on  the  one  display. 

(ta)  There  was  enthusiasm  for  the  availability  of  such 
information  as  height  warnings  and  optimum/safety/ 
limit  speeds  whenever  relevant. 


(c)  The  map  format  was  thought  to  be  excellent.  It  is 
clear  tiiac  the  provision  of  a  map  display  "astern''  of 
tne  aircraft  symbol  has  significant  benefits  for 
pilot  orientation.  Moreover,  by  enabling  the  pilot 
to  study  the  intended  route  and  the  destination  area, 
the  "look  ahead"  facility  was  considered  a  substantial 
aid  to  he  cask  of  making  changes  to  the  programm.ed 
flight  plan. 

(d)  Two  adverse  critisms  were: 

(i)  The  presentation  of  analog  radar  height 
i.nfornation  when  available  (by  superimposing 
it  on  the  barometric  altimeter  scale). 

(ii)  Heading-related  information  on  the  scales 
beneath  the  attitude  indicator  was  cramped. 

(e)  Those  pilots  with  experience  of  electromechanical 
strip  scales  considered  that  this  type  of  presentation 
should  be  used  on  the  PFD  for  the  display  of  airspeed, 
altitude  and  vertical  speed. 

Color 

The  best  colors  were  judged  to  be  cyan,  white  and  green, 
for  they  provided  easily  distinguishable  sharp  images. 

The  most  uncc.mf ortaole  color  was  magenta,  considered 
somewhat  harsh.  Other  colors  used  in  the  BAC  1-11  displays 
were  amber,  blue,  brown  and  red.  (Fig.  6) 

These  eight  colors  were  sufficient  for  the  formats  used  on 
the  aircraft.  A  total  of  15  colors  could  have  been  made 
available  by  the  system  but,  since  the  principal  uses  of 
color  are  the  decluttering  and  coding  of  information,  the 
use  of  more  than  8  colors  would  probably  have  been  counter¬ 
productive.  Indeed,  the  use  of  fewer  colors  may  offer 
advantages,  given  the  appropriate  format. 


To  allow  for  extended  viewing  periods,  colors  selected  to 
display  "normal"  flight  information  must  be  balanced. 

This  means  that  one  color  should  not  appear  harsher  and 
so  more  demanding  of  the  pilot's  attention  than  the  others 
The  latter  characteristic  is  of  course  an  obvious 
requirement  for  the  display  of  warning  information. 

The  universally  accepted  color  for  warnings  is  red  but  a 
more  striking  color  for  this  purpose  is  magenta.  Warning 
indication  could  therefore  more  effectively  be  given  using 
a  red  which  is  closer  to  magenta  in  the  color  spectrum. 

All  of  this,  of  course,  begs  the  question  already  asked 
by  so  many  pilots;  why  has  there  been  no  standardization 
in  the  use  of  colors  by  the  manufacturers?  In  fact 
working  groups  have  been  set  up  to  make  recommendations 
for  commercial  transport  aircraft  displays,  including 
adoption  of  the  current  practice  of  using  red,  yellow  and 
green  for  weather  radar  information.  We  should  hope  that 
these  recorrariendations  will  assign  preferred  colors  to  the 
most  used  display  functions.  White,  cyan  and  green  are 
suggested  as  suitable  colors  and  actual  values,  selected 
values  and  scales  are  considered  to  be  the  most  used 
display  functions. 


Legibility 

No  difficulty  was  encountered  in  reading  the  displays, 
regardless  of  lighting  conditions.  Color  saturation  is 
reduced  when  direct  sunlight  is  on  the  CRT  but  the  colors 
have  nevertheless  been  distinguishable  even  under  the 
strongest  sunlight  experienced.  Despite  the  fact  that 
CRT  brightness  was  considered  perfectly  acceptable  for 
transport  aircraft  applications,  the  neutral  density 
filters  originally  used  on  the  BAC  1-11  displays  are  now 
being  replaced  by  optical  'triple  notch'  filters  to 
improve  the  contrast  further. 


The  smallest  characters  used  in  the  formats  were  3  mm 
(0.118  in)  high-  Although  no  pilots  found  these  characters 
illegible,  a  minimum  height  of  4  mm  (0.157  in)  was 
considered  preferable . 

Both  the  displays,  PFD  and  ND,  were  legible  from  the 
opposite  side  of  the  BAG  1-11  coclcpit  with  no  parallax 
error.  This  feature  will  be  a  benefit  in  the  truly  "all- 
glass"  coclcpit,  from  the  point  of  view  of  system  integrity, 
but  care  will  nevertheless  need  to  be  taken  in  cockpit 
display  definition  to  avoid  deep  bazels  or  excessive  tube 
curvature . 

Flicker  and  Aooarent  Movement 


The  initial  refresh  rate  selected  for  the  displays  was 
50  Hz.  At  this  rate,  some  flicker  was  perceptible  and 
many  pilots,  seeing  the  displays  for  the  first  time,  observed 
small  apparent  movements  of  the  symbology  -  the  so-called 
"jump"  effect.  This  is  due  to  the  interaction  between 
the  moving  fixation  point  of  the  eye  and  the  refresh 
pattern  of  the  display.  Neither  flicker  nor  jump  degraded 
normal  pilot  performance  and  indeed  these  phenomena  were 
not  observed  by  pilots  when  concentrating  their  attention 
on  the  displays.  Nevertheless,  both  effects  are  undesirable 
because  they  may  tend  to  lower  the  pilot's  confidence  in 
the  integrity  of  the  displayed  information.  Moreover, 
flicker  may  reduce  the  impact  of  flashing  warning  symbols 
and  indeed  can  degrade  pilot  performance  if  the  frequency 
is  as  low  as  15  Hz.  Increasing  the  refresh  rate  to  60  Hz 
removed  the  flicker  and  reduced  the  jump  effect  and  a 
rate  of  about  70  Hz  effectively  eliminates  these  effects. 

Eye  Fatigue 

Eye  fatigue  was  not  a  problem.  On  the  contrary,  the  uniform 
lighting  intensity  of  the  displays  at  night  was  considered 
to  be  far  more  restful  to  the  eye  than  the  standard  of 
lighting  seen  on  the  instrument  panel  of  most  current  aircraft 


Sununary  of  BAC  1-11  Assessment 


The  following  summarizes  the  conclusions  reached  after 
the  BAC  1-11  flight  assessment: 

(a)  Color  displays  of  this  kind  improve  the  interface 
between  complex  avionics  and  the  flight  crew. 

(b)  This  integration  was  foreseen  as  becoming  essential 
in  the  more  demanding  air  traffic  environment  of 
the  future . 

(c)  There  was  agreement  among  a  large  representative 
sample  of  pilot  opinion,  on  fundamental  issues: 

(i)  The  use  of  a  single  large  format  color  CRT 
as  a  complete  source  of  primary  flight 
information . 

(ii)  The  side-by-side  configuration  of  PFD  and  ND. 

(iii)  The  use  of  the  map  mode  on  the  ND  reduced  the 
workload  associated  with  the  use  of  automatic 
navigation  functions. 

(d)  Those  pilots  who  had  used  both  monochrome  and  color 
displays  agreed  that  the  use  of  color,  enhancing  as 
it  did  the  presentation  of  information  in  general  and 
of  primary  flight  data  in  particular,  had  substantially 
reduced  the  workload  of  extracting  information  from 
the  display. 

(e)  The  use  of  color  displays  in  the  less  benign  environ¬ 
ment  of  the  military  strike  aircraft  cockpit  should 
provide  adequate  legibility  under  bright  sunlight 
conditions . 

Additional  Research 

Since  the  completion  of  flight  assessment  in  the  BAC  1-11, 
further  research  has  continued  in  the  UK  in  connection 
with  various  aspects  of  color  display  systems  but,  although 
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some  software  changes  to  the  BAG  1-11  displays  have  taken 
place,  no  significant  hardware  changes  have  been  made  and 
the  large  format  units  continue  to  serve  as  a  research 
aid  in  the  airborne  assessment  of  other  avionic  systems 
at  RAE  Bedford, 

The  civil  flight  deck  simulator  studies  at  Weybridge  have 
now  included  a  comparison  between  the  BAG  1-11  side-by-side 
configuration  of  Form  Factor  D  units  and  a  one-over-the- 
other  configuration  of  Form  Factor  C  units.  (Fig.  7) 

The  use  of  the  smaller  display  units  on  the  2nd  pilot's 
panel  precluded  the  presentation  of  circular  analog 
scales  for  airspeed,  height  and  vertical  speed  and  these 
were  replaced  by  vertical  strip  displays  on  the  Form 
Factor  D  displays  as  well.  (Fig.  8)  The  attitude  display 
became  a  truncated  circle,  with  a  larger  radius  on  the 
Form  Factor  D  than  on  the  BAG  1-11.  On  the  Form  Factor  G 
displays,  the  presentation  of  heading  was  limited  to  the 
lower  HSI  display.  Other  noteworthy  symbology  changes 
included : 

(a)  The  provision  of  (cyan)  "boxes",  for  selected  values 
of  airspeed  and  height,  which  are  superimposed  on 
the  respective  strip  scales. 

(b)  "Rolling  counter"  numerical  readouts  of  actual  values 
of  speed  and  height. 

Military  Studies 

Further  research  work  on  color  displays  for  airborne 
military  applications  includes: 

(a)  Simplification  of  system  hardware. 

(b)  Provision  of  symbol  generation  within  the  display 
unit . 


(c)  Environmental  hardware  studies  vis-a-vis  color 
displays  in  the  helicopter  cockpit. 


(d)  Compatibility  studies  of  color  displays  and  night 
vision  goggles. 

(e)  Provision  of  primary  flight  information  on  smaller 
display  units. 

(f)  Pseudo  3D  displays. 

Several  of  these  areas  merit  a  separate  dissertation  of 
their  own  but,  in  the  context  of  this  paper,  which  has 
been  heavily  slanted  at  the  human  factors  aspects  of  color 
displays,  further  mention  is  probably  appropriate  only 
in  respect  of  the  last  two,  especially  as  far  as  the 
military  single-seat  strike  aircraft  cockpit  is  concerned. 
It  is  in  this  environment,  possibly  more  than  any  other, 
that  pilot  workload  reduction  opportunities  can  never  be 
ignored. 

Multi-Purpose  Displays 

Dimensional  limitations  of  the  strike  aircraft  cockpit 
has  led  to  the  general  adoption  of  the  Multi-Purpose 
Displays  (MPD)  and  current  development  in  shadow  mask 
CRTs  will  provide  full  color  displays  of  adequate 
ruggedness,  brightness  and  resolution  for  most  purposes. 

In  particular,  a  reduced  screen  phosphor  dot  triad  pitch 
of  0.2  mm  will  offer  a  usable  beam  width  of  around  0.3  mm 
which  is  compatible  with  video  sensor  displays  (although 
the  full  resolution  of  an  875  line  sensor  could  not  be 
exploited  on  smaller  displays). 

Ruggedised  shadow  mask  technology  will  therefore  provide 
for  a  flexible  mixture  of  stroke  and  raster/video  formats 
as  appropriate  to  a  military  multi-purpose  display. 


Pseudo  3D  Displays 

The  introduction  of  perspective  topographical  displays  in 
lieu  of  a  conventional  moving  map  presentation  may  be  the 
appropriate  point  at  v/hich  to  incorporate  the  well-publicized 


"highway-in-the-sky"  flight  guidance  techniques.  It  is 
probable  that  the  use  of  color  would  significantly  enhance 
a  combined  display  of  this  type.  Indeed,  it  is  likely 
that  only  by  the  use  of  color  could  such  a  combination 
become  generally  acceptable. 

Conclusion 

In  this  age  of  the  video  game  parlor,  there  ds  a  growing 
body  of  pilot  opinion  which  contends  that  addiction  to 
traditional  airborne  display  techniques  is  at  best  a 
failure  to  oprimize  the  flexible  characteristics  of  the 
color  CRT  and  at  worst  an  insult  to  their  data  assimilation 
capability . 
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Colors  used  in  the  BAG 

1-1]  displays 

had  the  following 

CIE  co-ordinates : 

X 

Y 

Red 
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0 .322 

Green 

0.290 

0.588 

Blue 
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0.166 

• 

Cyan 
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Yellow 
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Magenta 

0.282 

0.172 

White 

0.333 

0.333 

*  Sky  Shading  (Blue) 

0.186 

0.191 

♦Ground  Shading  (Brown) 

0.556 
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*  (These  colors  were  written  at  lower 

intensity . ) 
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Abstract 


The  successful  incorporation  of  a  multi  color  shadow  mask  CRTs  in- commercial 
air  transport  flight  decks  paved  the  way  for  a  broad  range  of  potential 
application  of  shadow  mask  technology  in  the  military  avionics  environment.  The 
initial  application  of  multi  color  shadow  mask  technology  in  a  tactical  aircraft 
is  being  applied  in  the  F-15  aircraft  under  contract  with  MCAIR. 

A  very  high  resolution  multi  color  shadow  mask  cathode  ray  tube  display, 
designed  specifically  for  military  avionics,  is  described.  The  F-15  display 
accommodates  either  a  very  high  resolution  CRT  developed  for  this  application  in 
conjunction  with  Tektronix,  Inc.,  or  a  conventional  high  resolution  shadow  mask 
CRT  from  a  Japanese  supplier. 

An  overview  of  the  F-15  system  is  provided  including  functional  modes  and 
capabilities.  Typical  operational  display  formats  are  shown,  including  multi 
color  stroke-generated  maps.  A  discussion  of  multi  color  shadow  mask  CRT's  is 
provided  in  terms  of  resolution,  brightness,  color  and  color  purity.  Color 
filtering  and  contrast  enhancement  are  discussed.  Additional  multi  color  shadow 
mask  development  are  discussed  such  as  the  nev;  very  high  resolution  5"  X  fi"  CRT 
and  the  new  Commercial  ARINC  "D  size". 


Introduction 


The  U.S.  Air  Force  conducted  studies  into  the  use  of  Color  Displays  in  the 
cockpit  and  their  capability  of  meeting  the  military  environment.  The  first 
study  in  1978  for  Warner  Robbins  AFB  involved  placing  a  color  weather  radar 
display  in  the  C-141  aircraft.  The  results  of  some  testing  and  data  indicated 
that  the  displays  would  not  meet  the  military  requirements  to  the  full  extent. 
Warner  Robbins  proceeded  with  the  color  weather  radar  system  and  it  has  been 
well  accepted.  The  user  has  requested  an  expanded  role  for  the  displays  (i.e., 
symbology  for  data  presentation  in  addition  to  just  radar) . 

The  second  study  was  requested  by  the  F-15  System  Program  Office  (SPO)  to 
investigate  the  feasibility  of  using  a  color  display  in  a  bubble  canopy  fighter 
cockpit  environment.  The  need  for  color  had  to  be  established.  A  report  of  the 
studies  conducted  by  D.J.  Oda  of  Lockheed  Co.  on  ASW  Aircraft  such  as  S-3A 
indicated  that  color  displays  reduced  the  average  ASW  display  analysis  time 
from  9.16  seconds  for  a  monochrome  display  to  3.16  seconds  for  color. ^  Studies 
were  conducted  by  the  Air  Force  Flight  Dynamics  Laboratory  for  the  early 
Joint/Tactical  Information  Distributor  System  (JTIDS)  effort  to  determine  if 
color  coded  symlools  in  a  highly  dense  situation  display  could  improve  pilot 
performance  and  reduce  workload.  The  findings  indicated  that  color  coded 
symbology  provided  a  significant  reduction  in  the  error  rate  and  detection 
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time. 2  McDonnell  Douglas,  as  part  of  the  JTIDS/F-15  effort,  conducted 
simulation  tests  of  a  monochrome  display  versus  a  color  display.  The  MCAIR 
findings  indicated  a  color  display  was  a  necessity  once  a  high  density  JTIDS- 
tactical  display  was  presented.  The  unanimous  opinion  of  the  users  was  that  the 
JT’IDS  display  must  provide  color  in  the  single  seat  cockpit  to  be  useable. 3  The 
Air  Force  Homan  Factors  Engineering  group  ASD/ENECH  conducted  single  seat  air  to 
ground  evaluation  of  a  color  display  versus  a  monochrome  display.  Their 
unpublished  findings  indicate  that  a  color  tactical  display  had  a  definite 
advantage  in  single  seat  operations.  Discussions  with  A-10  French  and  British 
test  pilots  all  indicate  that  a  color  moving  map  display  is  extremely  more 
useful  than  a  monochrome  display.  Additional  flight  tests  will  tje  forthcoming 
on  color  displays. 

During  the  second  study,  contrast  and  brightness  tests  were  made  on  a  color 
beam  penetration  CRT  in  a  military  point  source  ambient  environment.  The  beam 
penetration  display  did  not  have  enough  brightness  to  be  totally  useable.  The 
color  beam  penetration  CRT  display  was  modified  with  a  directional  filter  and 
testing  reconducted,  this  time  successfully  passing  the  test.  The  F-15  SPO  was 
notified  that  a  suitable  color  display  could  be  designed  to  meet  the  bubble 
canopy  environment.  The  color  beam  penetration  CRT  would  provide  three  colors, 
red,  yellow  and  green,  for  threats,  unknown  and  friendly,  in  a  tactical 
presentation. 

During  the  development  of  the  beam  penetration  CRT  display  criteria,  Boeing 
Aircraft  Company  announced  their  selection  of  a  color  shadow  mask  CRT  display 
for  the  757/767  aircraft.  Not  too  long  after  that  the  European  Airbus  also 
announced  it  would  use  a  shadow  mask  color  CRT,  The  F-15  SPO  requested  Air 
Force  engineering  to  evaluate  the  possibility  of  using  the  color  shadow  mask  CRT 
in  the  F-15  aircraft  in  lieu  of  the  beam  penetration  CRT.  A  third  study  was 
conducted  in  1980.  Sliadow  mask  color  CRT's  were  tested  for  brightness  levels  in 
the  stroke  mode.  The  shadow  mask  stroke  mode  displays  were  also  visually  tested 
for  suitability  of  color  difference  identification  in  the  high  ambient 
illumination.  The  results  of  the  readability  tests  of  a  shadow  mask  CRT  in  high 
ambient  were  very  satisfactory,  however,  reservations  were  pointed  out  to  the  F- 
15  SPO  about  the  vibration  problems  that  may  be  encountered  due  to  the  high 
level  of  vibration  in  a  military  fighter  compared  to  a  conmercial  aircraft. 
Demonstration  tests  were  set  up  for  Air  Force  witnessing  to  demonstrate  a 
ruggedized  shadow  mask  CRT  design  for  withstanding  the  vibration  levels.  The 
tests  indicated  that  a  color  shadow  mask  CRT  could  indeed  be  used  in  a  military 
vibration  and  ambient  light  environment.  The  F-15  SPO  was  notified  that  either 
color  display  technology  could  be  used  to  meet  the  JTIDS  display  requirements, 
however,  the  color  shadow  mask  CRT  provided  the  most  flexibility  for  growth  into 
other  display  applications  such  as  moving  map  display,  caution  and  warning, 
flight  instruments,  etc. 


F-15  Color  Display 

Sperry  Flight  Systems  was  awarded  the  contract  by  McAir  for  the  F-15  Color 
display  system  for  the  JTIDS/PACS  (Programmable  Armament  Control  System) 
display.  Because  of  the  unique  shape  of  the  JTIDS/PACS  display,  Sperry 
developed  an  additional  display  in  a  more  standard  configuration  utilizing  the 
same  subassemblies  was  developed  for  other  application  such  as  the  Dual  Role 
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Fighter  (DRF) .  The  JTIDS/PACS  display  is  a  color  display  that  was  designed  for 
forward  and  retrofit  applications  into  all  existing  F-15s.  The  F-15E  (DRF)  will 
utilize  three  of  the  square  standard  configuration  5-inch  color  displays. 

The  Multipurpose  Color  Display  (MPCD)  is  a  high  resolution  5-inch  by  5-inch 
shadow  mask  display  unit  capable  of  displaying  stroke,  raster  or  hybrid  (stroke 
and  raster)  formats  in  full  color  and  is  driven  by  the  Programmable  Signal  Data 
Processor.  The  stroke  symbology  can  be  displayed  in  any  of  16  different  colors, 
with  each  of  the  color  coordinates  programmable  by  symbol  generator  software. 

In  the  raster  mode  the  red,  green,  and  blue  outputs  of  a  color  sensor  or 
subsystem  are  processed  to  display  full  color  analog  raster  such  as  the  remote 
map  reader  planned  for  the  F-15E. 

Progranmable  Signal  Data  Processor  (PSDP) 

A  programmable  signal  data  processor  designed  by  Sperry  drives  the  MPCD.  As 
shown  in  figure  3,  the  PSDP  interfaces  with  aircraft  avionics  and  sensors,  and 
processes  the  data  to  generate  independent  formats  on  two  monochrome  displays, 
one  color  display,  and  a  repeater.  'Itie  PSDP  contains  two  separate  processing 
systems  in  one  package  —  a  triple-channel  symbol  generator  and  a  general 
purpose  processor.  The  symbol  generator  portion  processes  avionics  digital  and 
sensor  information  to  drive  the  four  displays.  The  general  purpose  processor 
can  be  used  for  a  variety  of  applications.  In  the  F-15  it  processes  JTIDS 
information  and  passes  the  resultant  display  formats  to  the  symbol  generator 
processor  via  a  shared  memory.  The  PGDP  also  acts  as  the  1553  Bus  Controller 
for  the  JTIDS  System  and  as  the  aircraft  overload  "G"  warning  computer. 

The  symbol  generator  processor  software  contains  a  macro  interpreter  that 
provides  flexibility  in  generating  formats  from  external  (central  computer  and 
radar)  and  internal  (GP  processor)  sources.  Essentially,  the  display  macro 
approach  establishes  a  data  base  in  the  PSDP  RAM  that  is  fully  controllable  by  a 
driver  in  the  central  computer  or  GF  processor.  This  driver  can  change  the 
commands  and  data  sets  within  a  macro  program  at  any  time  in  order  to  add, 
remove,  change  or  move  symbols  on  the  display  screen.  The  macro  interpreter 
converts  the  data  base  to  object  code,  which  is  directly  executable  by  the 
symbol  generation  channels.  This  type  of  configuration  yields  optimum 
capability  and  flexibility  yet  is  conservative  in  the  use  of  the  PSDP  and 
central  computer  memory  space. 

The  PSDP-MFCD  interface  is  shown  in  figure  4.  The  multiplex  interface 
(data,  clock,  and  initiate)  is  a  unidirectional  serial  bus  that  routes  switch 
and  BIT  data  from  the  MPCD  to  the  PSDP.  Data  transfer  is  controlled  by  a 
special  I/O  instruction  in  the  symbol  generator  processor.  Deflection  signals 
contain  combined  stroke  and  raster  information  since  the  sweep  generators  are 
located  in  the  PSDP.  Horizontal  sync  is  used  in  the  raster  portion  of  the 
hybrid  mode  to  flyback  the  X  beam  to  the  left  edge  of  the  screen.  Vertical 
blank  and  raster/stroke  signals  are  used  to  switch  between  stroke  and  raster 
modes.  The  end  of  slew  signal  enables  writing  stroke  symbology  once  the  beam  is 
settled  after  a  new  command  position.  BIT  initiate  commands  the  display  to  the 
initiated  BIT  mode.  Brightness  and  contrast  functions  are  processed  in  the  PSDP 
in  response  to  rocker  switch  depressions  processed  by  the  PSDP  to  generate  the 
focus-control  signal,  which  maintains  sharp  focus  at  ail  brightness  levels.  The 
red,  blue,  and  green  drive  signals  contain  combined  stroke  and  raster  video. 


A  5  X  5-inch  high-resolution,  delta  gun  shadow-mask  CRT  is  used  in  the 
MPCD.  Dynamic  and  static  convergence  are  provided  to  obtain  maximum  symbol 
fidelity.  High  ambient  viewability  is  achieved  by  using  a  25  kV  anode  voltage, 
in  concert  with  a  bandpass  filter  on  the  CRT  and  17K  inches-per-second  stroke 
writing  speed-  TWo  CRT  versions  are  being  developed  that  will  be 
interchangeable  at  the  CRT  and  yoke  assembly  level.  The  Matshusita  CRT  has  a 
spacing  of  0.012  inch  between  color  triads  and  the  Tektronix  version  has  a 
spacing  of  0.008  inch.  Both  CRT  assemblies  will  be  qualified  under  the  F-15 
program. 

Figure  1  shows  the  packaging  for  the  JTIDS/PACS  MPCD.  Figure  2  shows  the 
packaging  for  the  F-15E  MPCD.  The  subassemblies  are  mounted  to  the  bottom,  side 
walls,  or  internal  deck  structure  as  shown.  Coldwalls  remove  heat  from  the 
horizontal  and  vertical  deflection  amplifiers,  which  accounts  for  60  percent  of 
the  total  heal  dissipation  in  the  MPCP.  A  combination  of  coldwall  and 
impingement  cooling  provides  cooling  for  the  other  subassemblies.  The  CRT  and 
yoke  asranbly  shown  in  figure  5  contains  the  CRT,  bandpass  fiJter,  deflection 
yoke,  convergence  yoke  and  purity/blue  lateral  assembly. 

Typical  color  display  formats  are  shown  in  figures  6  and  7.  The  color  map 
system  was  flown  on  the  F-15  as  part  of  the  Advanced  Fighter  Concept 
demonstrator  program. 

Sperry  initiated  a  development  program  jointly  with  Tektronix  of  Beaverton, 
Oregon  to  develop  a  U.S.  source  for  high  resolution  CRTs  applicable  to  military 
programs.  With  the  CRT  being  a  critical  component  of  the  display,  the 
development  of  a  CONUS  source  for  the  shadow  mask  CRT  seemed  to  be  necessary  for 
security  reasons.  The  technologies  developed  by  Tektronix  have  resulted  in 
significant  performance  advantages  over  color  CRTs  of  conventional  shadow  mask 
design.  The  CRT  developed  under  this  program  was  developed  for  the  military 
environment  and  therefore  exhibits  superior  vibration  resistance,  viewability  in 
high  ambient,  raster  presentations  with  higher  resolution  and  higher  brightness 
than  any  other  avionic  shadow  mask  CRT  in  the  world. 

The  technical  details  of  the  Tektronix  CRT  are  further  defined  in  reference 
four.  For  comparison  purposes  with  the  Japanese  CRTs  some  of  the  differences 
are  as  follows: 

a)  The  CRT  face  is  flat. 

b)  The  funnel  of  the  CRT  is  a  pink  beige  and  opaque  and  made  of  a 
special  ceramic  material. 

c)  The  faceplate  is  clear  instead  of  a  neutral  density  filter  and  the 
screen  appears  to  be  gray  and  devoid  of  a  dot  pattern  as  in  the 
conventional  shadow  mask  CRTs. 

The  gray  appearing  screen  is  the  result  of  the  phosphor  dot  size  and  spacing 
which  is  two-thirds  of  the  conventional  high-resolution  avionic  shadow  mask  CRT 
and  therefore  below  the  discrimination  threshold  for  normal  vision  at  design  eye 
distances  of  28-30  inches.  The  electron  gun  is  a  delta  design  in  order  to  help 
establish  the  very  high  resolution  capability  of  the  CRT  as  well  as  placing  more 
energy  on  the  CRT  phosphor  spots  for  improved  brightness.  The  clear  flat 
faceplate  has  a  bonded-on  multiple  bandpass  filter.  The  flat  face  eliminates 
parallax  problems  associated  with  a  curved  faceplate  and  filter  combination. 

The  clear  faceplate  virtually  commits  all  of  the  generated  CRT  luminosity  to  the 
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selected  filtering  of  the  contrast  enhancement  filter.  The  ceramic  CRT  body 
provides  for  both  x-ray  attenuation  and  strength-  With  direct  control  over  the 
shape  of  funnel  and  flare  of  the  tube  the  manufacturer  can  contour  the  CRT  to 
conform  to  a  optimally  designed  and  shaped  deflection  yoke  for  a  small  gain  in 
deflection  sensitivity.  (See  figure  8.) 

Because  the  MPCD  was  going  into  a  tactical  fighter  aircraft,  particular 
attention  was  paid  to  the  vibration  characteristics  and  design  in  both  CRTs  and 
CRT  assemblies.  'Ihe  Mashushita  CRT  was  modified  to  improve  its  rugged ization. 
The  Tektronix  CRT  was  designed  from  the  beginning  with  a  military  application  in 
mind. 

The  vibration  hardening  of  the  Tektronix  CRT  was  carried  out  in  phases  in 
which  each  major  component  of  the  CRT  was  independently  designed  and  adapted  to 
meet  the  stringent  military  vibration  requirements.  The  approach  taken  was  to 
treat  the  vibration  dynamics  of  the  CRT  assembly  as  a  system,  which  includes  the 
resilient  mount.  Consequently,  the  natural  resonance  of  gun  and  mask  are  tuned 
away  from  the  relatively  low  frequency  of  the  mount. in  order  to  reduce  the 
response  to  energy  transmitted  through  the  CRT  mount.  Special  shadow-mask 
spring  and  mount  designs  are  required  to  counter  both  linear  and  torsional 
loadings  imposed  on  the  mask  assembly  during  vibration.  Direct  electrical 
connection  is  made  from  the  anode  to  the  shadow  mask  in  this  CRT. 

Conventionally,  the  anode  voltage  is  conducted  to  the  shadow  mask  through 
snubber  springs  welded  to  the  mask  and  resting  in  spring  contact  with  the  inner 
conductive  surface  of  the  CRT.  The  direct  connection  is  incorporated  to 
preclude  the  possibility  of  any  "open"  that  might  occur  through  spring-contact 
bounce  or  scrubbing  at  the  contact  point. 

Many  of  the  gun  components  are  strengthened  or  reinforced  in  order  to 
maintain  proper  geometry  and  centering  in  the  gun  end  of  the  CRT  during  and 
after  vibration  at  military  levels.  The  CRTs  have  remained  fully  operational 
after  endurance  testing  in  the  specially  designed  mounting  system  at  levels  in 
excess  of  9  grms  random  for  more  than  two  hours  per  axis.  The  display  can  be 
operated  at  levels  in  excess  of  5  grms  random. 

The  unique  construction  of  the  Tektronix  shadow  mask  makes  possible  the  very 
high  resolution  of  this  CRT.  In  contrast  to  the  domed  shadow  mask  of  the 
conventional  CRT,  the  Tektronix  design  features  a  thin,  flat,  taut-foil  mask 
that  i^ermits  the  formation  of  a  dot  pattern  with  two  thirds  the  dot  size  and 
spacing  of  other  high-resolution  avionic  shadow-mask  CRTs.  A  specially  designed 
support  system  is  required  to  maintain  the  positioning  of  the  shadow  mask  with 
sufficient  accuracy  and  repeatiblity  to  permit  the  formation  of  the  very  high- 
resolution  dot  pattern.  The  mask  design  is  complemented  by  a  photolithographic 
process  for  the  formation  of  the  high  definition  black  matrix  background,  and  by 
a  unique  automasking  process^  for  deposition  of  the  actual  phosphor  dot 
patterns.  Thie  thin-film  composition  employed  for  the  black  background  is 
optically  matched  at  the  glass  interface  to  minimize  the  reflected  light. 

Conventional  high  resolution  avionic  CRTs  have  a  dot  spacing  of  .012  inch 
(0.3  millimeter).  Tlie  very  high  resolution  design  has  spacings  of  .008  inch 
(0.2  millimeter)  and  corresponding  small  phosphor  dots.  At  normal  pilot  viewing 
distances  the  threshold  of  perception  is  at  about  one  minute  of  angular 
subtense,  about  .008  inch  at  28  inches.  The  dot  pattern  of  this  CRT  is  not 
perceptible  at  the  usual  viewing  distances.  The  stairstepping  usually 
associated  with. gently  curving  or  slightly  off-axis,  stroke-written  lines  is 
noticeably  reduced  in  this  tube. 
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However,  two  of  the  most  important  assets  of  this  very  high-resolution  CRT 
are  associated  with  raster  presentations.  As  shown  in  Table  1,  the  smaller 
geometries  of  the  phosphor  dot  pattern  permit  a  significant  increase  in  the 
number  of  line  pairs  per  inch  resolvable  in  this  display:  70  versus  50  for 
comparable  modulation  levels.  A  larger  number  of  line  pairs  are  possible 
provided  the  modulation  requirement  of  the  lines  are  reduced.  At  reduced 
brightness  and  modulation  the  Moire'  limit  of  90  line  pairs  per  inch  is 
possible.  Putting  it  in  slightly  different  terms,  this  new  CRT  will  exhibit  a 
greater  depth  of  modulation  (more  detail  contrast)  than  other  high-resolution 
shadow-mask  CRTs,  given  the  same  analog  raster  input  from  an  airborne  sensor. 
This  is  possible  because  smaller  raster  linewidths  are  usable  in  the  very  high- 
resolution  tube.  It  is  not  simply  the  spacing  between  ranks  of  dots  in  the 
phosphor  screen  that  limit  the  raster  resolution  for  these  CRTs.  It  is  the  more 
complicated  Moire'  limit,  a  brightness  modulation  phenomenon  that  is  the  result 
of  interaction  between  the  dot-pattern  spacing,  raster  line  spacing,  and  the 
linewidth  of  the  raster  lines.  By  analysis  or  by  direct  measurement,  the 
linewidth  below  which  Moire'  interference  patterns  begin  to  appear  on  an 
otherwise  unmodulated  flat-field  raster  is  approximately  .015  inch  (linewidth 
measured  at  the  ha If -intensity  points)  for  CRTs  having  .012-inch  dot  spacing, 
and  about  .011  inch  for  CRTs  with  .008-inch  dot  spacing. 

The  second  major  attribute  of  this  CRT  is  its  raster  brightness  capability. 
Where  raster  presentations  are  displayed  on  shadow-mask  tubes,  the  brightness 
limit  of  the  presentation  is  not  always  imposed  by  the  ability  of  the  electron 
gun  to  deliver  a  sufficiently  large  or  adequately  focused  beam  current  to  the 
screen.  Racher  it  is  the  point  at  which  the  thermally  induced  dimensional 
changes  in  tne  mask  create  a  loss  of  color  purity  in  the  display.  This  is 
readily  demonstrated  with  CRTs  of  conventional  shadow-mask  construction  at 
surprisingly  low  beam  currents  when  a  flat-field  raster  is  displayed.  Many 
conventional  tubes  will  begin  to  lose  purity  at  unmodulated  team  currents  on  the 
order  of  200  to  300  microamperes,  less  than  1/4  watt  per  square  inch.  As  shown 
in  the  table,  the  Tektronix  CRT  is  capable  of  in  excess  of  1  watt  per  square 
inch  without  loss  of  color  purity.  This  corresponds  to  more  than  1250 
microamperes  total  beam  current.  These  raster  display  characteristics  are 
especially  valuable  in  the  display  of  sensor  data  in  situations  vrfiere  there  is 
relatively  little  contrast  present  in  the  imagery.  Under  these  conditions,  the 
background  brightness  of  the  display  is  usually  increased  to  a  level  where  the 
observer  can  be  sure  of  seeing  all  the  detail  present  against  a  relatively 
constant  brightness  background.  The  Tektronix  CRT  permits  a  much  higher 
background  brightness  level  than  the  conventional  CRT  to  be  set  without 
encountering  color  purity  loss  in  the  presentation. 

Contrast  enhancenient  of  the  F-15  MPCD  is  accomplished  with  a  single  layer 
triple  bandpass  filter.  The  transmission  characteristics  have  teen  designed 
such  that  a  balance  between  display  contrast  and  brightness  is  achieved. 

Displays  using  these  filters  have  been  demonstrated  outdoors  in  direct  sunlight 
of  Ari^ona  to  observers  from  the  Air  Force  and  airframe  manufacturers.  The 
displays  were  readily  readable  with  direct  sunlight.  The  stroke  symbology  was 
totally  discernible  despite  some  color  desaturation  effects  of  the  direct 
sunlight.  The  different  colors  of  a  raster  color  bar  pattern  were  also 
discernible  in  sunlight,  however  the  contrast  levels  are  much  lower  than 
monochrome  CRTs. 
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Advanced  Color  Display 

Sperry  has  also  cooperatively  developed  with  Tektronix,  a  6-inch  by  6-inch 
usable  screen  shadow  mask  CRT  using  the  same  technology  as  the  F-15  5X5 
display.  A  denonstrator  unit  has  been  built  and  has  performed  very 
satisfactorily.  The  larger  display  was  developed  for  many  reasons,  however  two 
basic  ones  exist.  The  first  is  for  the  combination  of  display  formats  on  one 
CRT.  Current  5-inch  color  CRTs  get  too  cluttered  when  a  HUD  type  integrated 
presentation  is  placed  on  the  CRT.  The  altitude,  airspeed  and  heading 
information  can  be  successfully  combined  with  attitude  information  on  the  6-inch 
CRT  without  reducing  the  symbology  size  to  unusable  levels  or  creating  undue 
clutter.  The  usable  screen  area  for  the  display  increased  by  44%  from  25  square 
inches  to  36  square  inches.  The  second  basic  reason  is  for  the  use  of  the  6X6 
shadow  mask  CRT  as  a  sensor  display.  The  resolution  using  a  1PI%  raster 
modulation  can  provide  a  display  with  420  discernible  picture  elements.  If  the 
modulation  requirement  is  reduced  and  the  ambient  brightness/CRT  brightness/spot 
size  can  be  moderately  controlled  480  discernible  picture  elements  can  be 
achieved  which  is  the  basic  resolution  of  a  525  TV  line  system.  The  six  inch 
very  high  resolution  Tektronix  CRT  can  be  used  for  sensor  presentation  without 
seriously  limiting  the  system  resolution  because  of  display  limitations.  In  the 
case  of  a  controlled  environment,  such  as  the  rear  of  a  S-3A,  B-52,  B-1,  AWACS, 
etc.,  the  display  will  not  limit  system  resolution. 

Sperry's  Commercial  Display  Division  has  also  developed  an  ARINC  D  size 
shadow  mask  color  display  with  6.7  inch  by  6.7  inch  usable  area.  The  display  is 
not  as  ruggedized  as  the  military  displays  built  by  the  Defense  System  Division, 
however  it  is  being  proposed  for  some  of  the  C-130  foreign  sales  aircraft.  The 
unit  could  be  further  ruggedized  for  special  application  or  used  as  designed  for 
benign  environments. 


Summary 

Color  CRT  displays  will  become  an  accepted  part  of  the  military  cockpit  and 
in  some  cases  the  dominate  feature  of  the  crew  station.  The  use  of  color 
displays  in  tactical  presentations,  threat  displays,  caution  and  warning,  and 
map  displays  can  reduce  pilot  workload  and  error  rates.  Additional  testing  is 
proceeding  to  determine  if  other  quantitative  benefits  can  be  proven  for  other 
display  applications  such  as  ADI,  HSI,  etc.  Almost  all  crew  members  indicate 
that  they  felt  their  performance  was  better  with  color  displays.  Many  crew 
stations  have  had  color  displays  for  years  with  aviation  red  and  aviation 
yellow,  in  addition  to  whites  and  blacks  and  many  have  used  color  electro¬ 
mechanical  ADIs.  Color  in  the  cockpit  will  definitely  increase  in  the  future. 

The  color  display  for  the  F-15  is  a  significant  step  in  the  direction  of 
high  resolution  color  displays  for  the  military  cockpit.  The  advancements 
produced  by  Tektronix  into  very  high  resolution/high  brightness  shadow  mask  CRTs 
will  increase  the  rate  of  incorporation  of  color  CRTs  into  the  cockpit.  The 
ability  of  using  a  color  CRT  as  the  sensor  display  will  further  enhance  the 
possibility  of  using  one  type  CRT  display  in  the  Crew  Station  for  reducing 
procurement,  development,  and  logistics  costs.  Research  work  is  being  done  to 
gnatly  increase  the  brightness  of  the  color  displays  so  that  raster  performance 
will  approach  current  monochrome  display  performance.  The  all  color  CRT 
military  cockpit  is  rapidly  approaching  reality  as  the  commercial  airlines  have 
done  in  the  757/767  and  A310. 
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In  recent  years  there  has  been  much 
in  military  aircraft  caused  by  the 
sati sfy  operational  requirements, 
towards  reduced  crew  complement  and 
deal  of  attention  has  been  given  to 
electronic  multipurpose  displays  to 
interface.  However,  if  we  take  a  w 
collection  of  interconnected  subsys 
subsystems  with  the  same  care  that 
interface  we  will  produce  an  avion! 
characteristics  plus: 


discussion  about  increasing  crew  workloaa 
proliferation  of  subsystems  needed  to 
Because  of  this  and  the  parallel  trend 
all  weather  day/night  capability,  a  great 
the  use  of  multifunction  control  heads  and 
produce  a  more  effective  crew/avionics 
ider  view  of  a  modern  aircraft  as  a 
terns  and  consider  the  integration  of  all 
we  currently  apply  to  the  man/machine 
cs  system  with  excellent  user 


The  ability  to  grow  in  an  evolutionary  manner. 

The  ability  to  tolerate  failures  and  damage. 

The  ability  to  support  enhanced  self  diagnostic  and  status  reporting 
functions . 

The  process  of  system  integration  has  been  greatly  facilitated  by  the 
development  of  military  standards  in  interconnect  media,  stores  interfaces, 
computers,  and  computer  languages.  This  paper  describes  the  evolution  of  our 
integration  viewpoint,  considers  the  drivers  and  candidate  subsystems  for 
integration  and  presents  some  examples  drawn  from  our  experience. 


[VOLOilON  OF  INIEGRflllON  VIEWPOINT 


3.  MISSION  RELATED  SENSORS 


TV 

Infra  Red 

Laser  -  I i 1 umi nator/Ranger/Des ignator 

Radar  -  Active/Passive 

Magnetic 

Acoustic 

SAR 

EW 

4.  COMMUNICATION 


Radios 

Satcom 

JTIDS 

PLRS 

Optical 

5.  COMPUTATION 


Navigation 

Weapons/fire  control 

Tracking/Correlation 

Communication  Management 

Aircraft  diagnostic/status  reporting 

Aircraft  systems  management  -  fuel  engine  parameters  etc. 

Stores  management 

6.  STORES 


Missiles 

Bombs 

Torpedoes 

ECM 

AFE 

This  long  list  only  contains  a  sample  of  the  functions  which  are  currently 
specified  and  serves  to  illustrate  the  scope  of  an  effective  systems 
integration  plan. 

Decades  ago  technology  dictated  that  only  the  most  basic  COM/NAV  functions 
were  available  packaged  on  a  function  per  box  basis.  Each  of  these  functions 
was  therefore  a  stand-alone  item  usually  having  a  dedicated  control /di spl ay 
interface  with  the  crew. 

More  recently  advances  in  electronics  and  the  use  of  general  purpose  avionics 
computers  have  altered  our  view  of  the  aircraft  from  a  collection  of  boxes  to 
a  set  of  subsystems  grouped  by  function.  At  this  stage,  however,  these 
subsystems  were  still  relatively  isolated  from  each  other  and  depended  on  the 
crew  to  ensure  cooperative  action.  Crew  workload  increase  therefore  became  a 
natural  consequence  of  increased  avionics  complexity  and  capability. 


Currently  several  military  agencies  ana  some  aerospace  ccnt'-actors  are  taKing 
a  holistic  approach  to  system  design.  Here  the  avionics  system  is  conceived 
as  a  puzzle  made  up  ot  functions  and  subsystems  each  of  which  have  their  place 
in  the  total  operational  'picture'.  Some  interlocking  pieces  can  stand  alone 
in  terms  of  a  few  very  limited  capabilities  or  the  picture  can  grow  as  new 
pieces  oecome  available.  The  availability  of  these  new  components  depends  on 
funding,  technology,  and  mission  requirements,  ail  of  wnich  are  time  related. 

The  ability  to  view  not  only  what  a  system  is,  but  also  what  it  will  become  is 
an  essential  aspect  of  modern  integrated  design. 

I  will  discuss  the  factors  which  demand  this  approach  in  a  moment,  but  before 
proceeding  it  is  worth  briefly  reviewing  the  integration  tools  which  support 
the  design,  integration  and  verification  process. 

1 .  Multiplex  Data  Buses 

As  illustrated  in  Figure  1  a  multiplex  data  bus  such  as  that  defined  by 
MlL-STD-1553  is  simply  a  common  cable  which  is  connected  to  several 
terminals.  Each  terminal  is  assigned  a  digital  'address'  which  enables  it 
to  identify  messages  intended  for  its  use.  One  of  the  terminals  is 
designated  'bus  controller'  and  has  the  duty  of  controlling  access  of  each 
terminal  to  the  common  interconnect  bus.  Each  terminal  is  assigned  a  time 
slot  regularly  so  that  it  can  communicate  with  other  units  on  the  bus. 

This  process  has  the  effect  of  replacing  the  bulky  point  to  point  physical 
wiring  common  in  older  aircraft  with  'virtual  wiring'  where  'messages' 
conveniently  take  the  place  of  physical  cables. 

Obviously  multiplex  data  buses  provide  tremendous  flexibility  for  growth 
by  avoiding  the  need  to  extensively  rewire  aircraft  in  order  to 
incorporate  new  functions.  There  is  a  caveat  however,  any  multiplex  bus 
has  a  finite  capacity  for  information  and  we  must  be  aware  of  the 
percentage  of  that  capacity  currently  utilized  when  planning  for 
expansion.  At  Rockwel 1 -Col  1  ins  we  recognized  the  need  to  control  and 
analyze  the  message  structure  and  capacity  utilization  of  multiplex 
buses.  We  therefore  developed  a  set  of  computer  tools  known  as  DBAS  (Data 
Bus  Analysis  System)  to  support  our  systems  integration  activities.  We 
anticipate  an  industry  wide  trend  towards  the  use  of  such  'smart'  support 
tools  as  system  complexity  continues  to  increase. 

2 .  Multifunction  Controls  and  Displays 

As  participants  in  this  symposium  I  am  sure  that  we  are  all  aware  of  the 
benefits  provided  by  multifunction  controls  and  displays.  A  great  deal 
has  been  said  about  the  use  of  color,  new  display  technologies,  and  novel 
methods  for  interaction.  However,  from  the  systems  integration  viewpoint 
the  principal  benefit  provided  by  these  interactive  media  is  the  ability 
to  design  a  standardized  control  sequence  which  is  independent  of  the  unit 
under  control.  For  example,  not  long  ago  each  radio  had  an  associated 
control  panel.  Generally,  the  crew  radio  tuning  actions  depended  on  the 
radio  being  tuned.  Now  of  course  we  are  able  to  provide  a  standardized 
radio  control  sequence  using  multifunction  control  display  units.  This 
has  the  important  consequence  that  we  can  change  the  physical 
implementation  of  radio,  or  the  radio  complement  without  having  to  retrain 
the  crew. 


.  '  .  -S.  ■  -V  ■ 
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SUPERVISORY  AND  DATA  EACH  DIRECTION 


Fiqu>-e  1.  Multiplex  Data  Bus  Conceptual  Diagram 
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A  sGCond  advantage  is  that  grov^th  in  functionality  does  not  always  need 
additional  control  heads  and  resultant  aircraft  ‘wiring  modification. 


3.  Moduiari ty 

Trends  in  electronic  packaging  and  software  design  have  lead  to  the 
development  of  modules  which  can  be  assembled  in  a  very  flexible  manner  to 
create  an  avionics  system.  Design  and  development  costs  force  us  to  avoid 
single  application  design  solutions.  Rather  we  develop  new  hardware  and 
software  modules  which  can  then  be  added  to  our  repertoire.  I  will  talk 
about  the  use  of  these  modules  later,  but  now  I  want  to  consider  the 
factors  which  necessitate  holistic  system  design. 


1 .  Mission  Enhancement 

The  need  to  incorporate  new  functions,  technologies,  crew  interaction 
mechanisms,  weapons  as  determined  by  role  or  operational  requirements. 

2 .  Crew  Workload 

The  need  to  provide  a  level  of  automation  which  allows  crew  to  function  as 
mi ssion  managers . 

3.  Graceful  Growth 


A  combination  of  1  and  2  above  should  ideally  allow  retrofit  without 
extensive  aircraft  modification  and  crew  retraining. 

4.  Graceful  Degradation 

System  integrity  considerations  include  identifying  the  survivability 
needs  of  the  various  components  or  subsystems  and  determining  what  role  is 
played  by  multiplex  bus  management.  How  can  partitioning,  redundancy,  and 
the  use  of  reversionary  modes  be  used  to  ensure  system  integrity? 


5 .  Funding 

Perhaps  one  of  the  most  important  roles  of  all  is  to  provide  the 
flexibility  needed  to  allow  the  weapon  system  to  be  upgraded  for  changing 
requirements.  Funding  is  getting  tighter,  yet  technology  is  progressing 
at  an  ever  increasing  rate  while  the  acquisition  time  appears  to  be 
lengthening.  All  of  this  only  serves  to  increase  the  probability  that 
threats  will  change  before  a  weapon  system  becomes  operational. 


INTEGSAIION  CSNCIDATES 


Types  of  functions  currently  integrated  inclide: 

CNI 

Stores 
Sensors 
Processors 
Controls 
Crew  I/O 

Even  recently  it  is  obvious  that  some  integrators  have  lost  sight  of  the 
integration  drivers  and  have  narrowed  their  focus  on  the  integration 
candidates.  Both  users  and  manufacturers  have  drifted  that  way  in  the  past. 

THE  COBBEMT  SITyUTlOH 

Three  major  events  have  manifested  themselves  over  the  past  few  years: 

1.  Acceptance  of  Multiplex  Bus  Architectures. 

2.  Powerful  and  Fast  Microprocessors. 

3.  Multifunction  Display/Input  Media. 

In  the  past  we  have  not  felt  the  dominance  of  these  integration  vehicles. 

Now,  the  acceptance  of  these  fully  developed  capabilities  gives  us  a  chance  to 
take  a  fresh  look  at  the  old  and  often  ignored  problem  of  the  hodgepodge 
growth  of  aircraft  systems. 

Many  of  today's  aircraft  have  avionics  systems  reminiscent  of  1950‘s 
technology  and,  although  providing  an  acceptable  level  of  performance,  this 
sort  of  system  design  has  limited  growth  and  enhancement  opportunities. 

How  can  the  multiplex  bus.  microprocessors,  and  multifunction  displays  help  us 
to  solve  this  age  old  problem? 

1.  Standardized  I/O  has  allowed  us  to  essentially  freeze  I/O  designs  and  be 
assured  that  future  equipment  will  be  directly  compatible. 

2.  Microprocessor  based  systems  have  the  capability  to  'go  back'  and  pick  up 
existing  functions.  As  an  example  consider  the  system  illustrated  in 
Figure  2  where  standard  modular  units 

Control  Display  Unit  (CDU) 

Bus  Subsystem  Interface  Unit  <B5IU) 

Display  Driver  Unit  (DDU) 

are  used  to  provide  the  benefits  of  electronic  instrumentation  and 
multifunction  control /di spl ay  while  utilizing  largely  'conventional' 
avionic  components.  Indeed  this  capability  is  so  powerful  that  it  is 
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iq'jre  2.  Mult  i  pi  ex  System  Incorpor  §■  Tradi  tional  Avionics 


possible  to  retrofit  existing  aircraft  rf'- th  core  multiplex  systems  which 
simultaneously  provides  for  future  rational  growth--wni le  allowing  the 
retention  of  existing  equipment.  I  wi 1 ■  ce  talking  more  aoout  this 
process  wnich  we  nave  termed  Retro-Evolution  in  a  moment. 

i.  Displays  have  the  capability  to  integrate  a  great  deal  of  information  ana 
display  't  in  a  meaningful  manner.  Mgure  3  is  an  example  of  one  Such 
tyoical  display  format. 


I  .  EVOLUTION  OF  ROLE  ADAPTABLE  AIRCRAFT  INSTALLATION 


The  core  of  the  system  illustrated  in  Figure  4  is  the  multiplex  system 
consisting  of  a  multifunction  CDU  and  an  intelligent  Bus  Subsystem 
Interface  Unit.  The  interfaced  avionics  fall  into  two  categories; 

a.  Bus  Compatible 

V/UHF  Radio 

b.  Non  Bus  Compatible 

IFF 

Secure  Voice  Equipment 

However,  the  crew  Is  able  to  exercise  multifunction  control  over  alj 
equipment  since  the  control /display  requirements  of  the  non  bus  compatible 
equipment  are  satisfied  by  special  Subsystem  Interface  Modules  (SIMs) 
which  when  plugged  into  the  BSIU  mimic  the  conventional  control  heac 
interface.  The  BSIU  also  contains  corresponding  software  modules  to 
support  tne  SIMs  and  the  control /di spl ay  page  structure. 

The  anticipated  growth  phases  are  also  i  1 1  ustra'ied . 

Phase  1  Growth : 

In  Phase  1,  we  see  the  addition  of  a  nor.  bus  compatible  multifunction  radar. 
Here  two  orinciples  are  employed; 

a.  A  SIM  is  used  to  provide  full  radar  control  via  the  multiplex  bus. 
Initially,  this  control  would  originate  at  the  CDU,  but  could  also  be 
provided  by  a  future  mission  processor. 

b.  A  monochrome  Display  Driver  Unit  (DDU)  and  display  heads  are  added  to 
provide  radar  display  with  overlayed  symbology  plus  electronic  ADI 
and  HSI  displays. 


TO  WEAPONS/ 
STORES 


Phase  Z  Growth: 


Phase  2  sees  the  i nccrporation  of  multiplex  bus  compatible  GPS.  No  aaaitional 
control  heads  are  involved  just  additional  CDU  'pages'.  At  this  stage  an 
Automatic  Target  Hanaoff  System  tATHS)  is  also  added.  ATHS  is  a 
sel f-contai .ied  subsystem  which  generates  its  own  set  of  CDU  pages  which  enaoie 
the  pilot  to  interactively  classify  and  identify  targets  ana  digitally 
transmit/receive  tactical  information  over  a  small  local  network.  The 
multiplex  bus  interface  enable  ATHS  to  collect  a  great  deal  of  data  from 
connected  aircraft  sensors  automatically  with  consequential  pilot  workload 
reduction.  By  utilizing  existing  voice  raaio  channels  for  its  burst  tone 
modulated  digital  transmissions,  ATHS  has  proved  very  effective  in  enhancing 
mission  performance  without  the  cost/space/power  penalties  usually  associated 
with  tactical  networks  like  Link  II . 

Phase  3  Growth: 

Finally,  phase  3  adds  an  additional  BSIU  acting  as  a  stores  management 
computer  contain  special  stores  interface  SIMs. 

2 .  AIRCRAFT  SYSTEM  RETRQ-EVOLUTION 

The  first  example  considered  how  a  communications  control  system  could  be 
designed  to  incorporate  and  support  several  aircraft  systems.  Here  we 
consider  an  existing  aircraft  where  cockpit  space  is  severely  limited  and 
pilot  workload  is  rapidly  approaching  saturation.  In  this  case  it  is 
possible  to  take  advantage  of  a  retrofit  opportunity  to  lay  the  foundation 
for  future  rational  growth.  This  process  is  termed  Retro-Evolution. 

We  assume  a  small  cockpit  equipped  with  a  radar  which  has  a  dedicated 
monochrome  display  head,  mechanical  flight  instruments  and  several  manual 
radio  control  panels . 

The  objective  of  the  core  retrofit  is  to  eliminate  the  mechanical  flight 
instruments  and  replace  the  dedicated  display  head  by  dual  color 
multipurpose  displays. 

This  is  accomplished  by  installing  a  Display  Generator  (DG)  together  with 
two  multifunction  displays.  Subsystem  Interface  Modules  (SIMs)  are  used 
as  in  the  previous  example  to  replace  the  existing  radar  control  head. 

The  radar  control  function  is  mechanized  using  software  interpreted  'soft' 
keys  surrounding  the  display  heads.  Radar  video  is  routed  to  either  or 
both  displays  via  the  DG.  Interface  Modules  allow  the  DG  to  access  all 
the  sensor  information  previously  available  in  the  aircraft.  It  should  be 
noted  that  this  core  system  does  not  use  the  multiplex  data  bus,  however, 
the  core  modification  provides  the  following  facilities: 

Dual  Independent  Displays 

Electronic  Flight  Instruments 

Waypoint  navigation  using  computer  embedded  in  DG 

Electronic  tactical  flight  plan  display  and  editing  with  optional 

radar  overlay 

Overlay  of  flags  and  status  symbols. 
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Phase  i  Gi'Owtn : 

The  first  enrancer.ent  cnase  's  tne  aadition  of  a  remote  map  reader  whicn 
is  control lec  and  orovided  with  oositiona!  information  via  the  multiplex 
cus.  Currently.  ':his  would  be  a  TV  scanned  fiim  unit,  but  in  the  near 
future  digitally  synthesized  2D/3D  units  will  become  available.  This 
addition  allows  overlayed  map.  flight  plan,  ana  other  symbology. 

phase  2  Growth : 

Here  the  radio  control  panels  are  removed  and  their  interfaces  with  the 
existing  COM/NAV  ■-adios  emulated  by  additional  SIM:  plugged  into  the 
Display  Generator  which  also  supports  tne  radio  management  software.  The 
pane!  space  so  liberated  could  be  used  to  support  a  multifunction 
control /di splay  unit  (CDU).  Alternately  the  ‘soft’  keys  surrounping  the 
displays  could  be  used  for  raoio  management  supported  by  a  remote 
keypoard.  Additionally  the  COU  could  be  augmented  by  a  compatible  voice 
recogni tionysynthesi s  unit.  This  phase  provides: 

Uniform  pilot/radio  interface 
Preset  and  symbolic  tuning 
Automatic  tuning 

while  retaining  traditional  radios. 

Phase  3  Growth: 

Here  the  existing  navigation  system  is  enhanced  by  the  addition  of  GPS. 
With  preplanned  expansion  to  GPS  the  navigation  software  within  the  OG 
would  accept  this  new  sensor  with  minimum  modification. 

Phase  4  Growth: 

A  self  contained  JTIDS  unit  is  added  which  together  with  software  in  the 
DG  enhances  the  tactical  role  of  the  aircraft.  The  color  displays  are 
used  to  present  net  derived  data  to  the  pilot. 

Obviously  these  examples  are  greatly  simplified  neglecting  redundancy  for 
example  but  they  do  serve  to  illustrate  that  the  flexibility  of  multiplex  bus 
can  provide  an  excellent  foundation  for  preplanned  product  improvement  for 
both  new  and  existing  systems. 

Recent  examples  of  Retro-Evolution  applications  include: 

KC-135  Fuel  Savings  Advisory  and  Cockpit  Avionics  System  for  US  Airforce 
Phased  retrofit  with  fuel  savings  advisory  core  growing  into  a 
fully  integrated  ‘glass'  cockpit. 

OH-58C  Light  Cavalry  Helicopter  for  US  Army 

Phased  retrofit  with  reduced  workload/enhanced  capability  in  a 
very  limited  cockpit  space.  A  radio  management  core  system  is 
currently  undergoing  planned  growth  to  include: 

Stinger  Missile  Control 
Roof  Mounted  Sight/Laser  Interface 
Automatic  Target  Handoff  System 
Again  the  goal  Is  a  fully  Integrated  cockpit. 
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CLCSING  REHUR^S 


Two  integration  scenarios  have  been  discussed  and  obviously  a  wide  variety  of 
other  possibilities  exist.  We  hope  that  these  examples  have  illustrated  the 
final  erosion  of  traditional  subsystem  boundaries  and  the  need  to  cross  the 
borders  of  CNI,  Stores,  Displays,  sensors  in  either  direction. 

Historically  novel  integrated  display  formats  have  been  proposed  which  cross 
traditional  subsystem  boundaries.  The  extension  of  the  Northrop  Maneuvering 
Flight  Path  Display  to  include  aircraft  status  information  is  one  example. 
Computers  and  buses  can  allow  us  to  achieve  this  level  of  display  integration 
but  these  tools  must  be  combined  with  a  total  system  viewpoint  to  be  fully 
effective . 

This  view  is  particularly  important  now  with  the  accelerating  pace  of 
technological  advance.  The  space  required  by  the  traditional  ATR  box  can  now 
be  used  to  provide  a  multitude  of  functions.  ICNIA  (Integrated  Communication 
Navigation  and  Identification  Avionics)  where  advanced  digital  signal 
processing  techniques  are  used  to  provide  all  CNI  services  in  the  frequency 
band  between  approximately  2  MHz  and  2  GHz  simultaneously  within  the  same 
LRU.  This  trend  to  size  reduction  will  increase  as  current  VHSIC  research 
bears  fruit. 

Additionally,  the  increasing  sophistication  of  our  etiemy  and  of  the  weapons 
deployed  against  us,  demand  the  development  of  new  techniques  including: 

Sensor  data  fusion 

Advanced  interactive  techniques,  voice,  sight,  etc. 

Artificially  intelligent  mission  management  systems 
Automatic  target  classification,  recognition  and  destruction. 

Recently,  as  part  of  the  Sikorsky  ARTI  team,  we  have  been  examining  system 
architectures  which  will  support  these  advanced  functions.  It  has  become 
evident  that  these  future  architectures  can  be  evolved  from  our  current 
designs  in  a  methodical  manner  albeit  with  the  use  of  faster  multiplex  buses 
and  advanced  electronics. 

In  conclusion,  we  believe  that  good  holistic  Integrated  system  design,  which 
is  adequately  supported  by  hardware  and  software  tools,  provides  the  following 
benef i ts ; 


Crew  workload  reduction 

Reduced  crew  training 

Fast  design,  development,  and  deployment 

Rapid  role/mission  adaptation 

Rapid  incorporation  of  new  technology  with  minimum  risk 
Rapid  incorporation  of  new  electronic  instrumentation  formats 
Optimized  cost/capability  profile. 
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Introduction 

The  introduction  of  the  electronic  fuel  control  to  modern  turbine 
engines  provides  the  user  with  a  quantum  increase  in  engine  performance  which 
reaches  to  the  edge  of  the  aircraft's  operational  envelope.  To  the  fighter 
pilot,  who  more  than  all  others,  demands  maximum  performance  and  flexibility 
coupled  with  carefree  engine  operation,  the  electronic  fuel  control  is  truly 
significant.  The  problems  associated  with  high  angle  of  attack  engine 
operation  from  the  surface  to  50,000  feet  can  be  largely  reduced,  if  not 
eliminated,  by  modern  engine  electronic  fuel  controls. 

A  spinoff  of  electronic  fuel  control  technology  is  the  vast  amount  of 
information  which  the  fuel  control  can  provide,  if  the  proper  engine  displays 
are  available  to  the  pilot.  This  paper  will  explore  some  of  the  wealth  of 
information  available  from  modern  fuel  controls  and  hopefully  stimulate  your 
thinking  as  to  improved  engine  display  formats  which  will  make  use  of  the 
current  technology. 


Digital  Electronic  Engine  Control 

The  electronic  engine  control  systems  which  make  possible  both  engine 
performance  improvements  as  well  as  data  availability  are  known  in  their  most 
recent  developmental  forms  as  the  Full  Authority  Digital  Engine  Control  or 
FADEC  and  the  Digital  Electronic  Engine  Control  or  DEEC.  These  controls 
consist  of  a  single  digital  channel  with  some  Internal  redundancy.  It  has 
self  test  capability  as  well  'as  failure  detection  and  accomodation  features. 

It  is  the  wealth  of  data  available  from  the  FADEC  which  is  our  primary 
interest  in  this  discussion.  Therefore,  we  will  now  look  at  the  many  bits  of 
information  which  a  modern  electronic  fuel  control  possesses  and  has 
available  for  display.  The  obvious  parameters  include  engine  mass  air  flows, 
engine  compression  ratio,  fuel  flows,  and  compressor  and  turbine  speeds. 
Additionally,  it  has  available,  as  input  or  output,  internal  temperatures  at 
a  variety  of  engine  stations.  The  position  of  various  internal  components 
are  also  monitored.  These  include  position  of  variable  compressor  vanes, 
nozzle  position  and  area,  bleed  valve  position,  and  the  position  of  various 
intake  components. 
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Additionally,  the  electronic  control  can  detect  engine  compressor 
stalls,  afterburner  selection,  and  subsequent  light-off  or  blow  out.  This  is 
by  no  means  a  complete  list  of  Information  available  with  an  electronic 
control,  but  it  provides  the  reader  with  an  idea  of  the  scope  of  data  at 
hand. 

Typical  Engine  Problems 

Given  such  broad  spectrum  capability,  one  may  ask  what  do  we  do  with  it 
all?  The  first  application  is  to  solve  typical  problems,  which  we  should  now 
review.  Stall/stagnation  problems  come  into  the  forefront  during  any  engine 
discussion.  These  stalls  range  from  the  obvious  to  the  subtle.  The 
conventional,  audible  "bang"  or  "pop"  of  the  compressor  stall  needs  little 
introduction  to  the  pilot.  The  less  obvious  quiet  stall  or  stagnation  more 
closely  associated  with  today’s  turbofan  tactical  jet  power  plant  frequently 
shows  an  insidious,  hard  to  detect  onset  with  potentially  disasterous 
results.  Here,  warning  the  aircrew  through  use  of  displays  becomes 
paramount. 

Sometimes  associated  with  the  stall  is  the  problem  of  variable  inlet 
malfunctions.  Modern  high  performance  aircraft  designs  often  require  complex 
variable  geometry  inlets  to  allow  for  normal  operation  at  very  low  as  well  as 
very  high  Mach  numbers.  Increased  complexity  has  attendant  reliability 
problems,  which  if  they  result  in  off  schedule  inlet  operation  can  result  in 
severe  engine  malfunctions. 

Other  problems  which  occur  include  total  or  partial  failure  of 
components  as  well  as  undetected  malfunctions  of  normally  governed  components 
which  allow  for  operation  in  a  misgoverned  condition.  Last  we  have  long  term 
deterioration  problems.  An  example  would  be  reduction  of  stall  margin  due  to 
blade  wear  or  salt  Ingestion. 

Solving  Problems  With  Displays 

Let's  now  look  at  two  typical  engine  problems  and  see  how  modern 
displays  turn  data  from  the  electronic  fuel  control  into  useiul  information 
for  the  aircrew.  The  occurrance  of  the  engine  stall  will  be  unexpected,  and 
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83  was  said  earlier,  the  cues  provided  to  the  pilot  will  range  from  startling 
to  undetected.  Additionally,  the  cues  provided  by  conventional  engine 
instruments  could  be  ambiguous  with  all  parameters  remaining  in  the  normal 
ooerating  range. 

Frequently,  stall  interpretation  requires  correct  analysis  of  multiple 
parameters:  rpm,  temperature,  fuel  flow,  throttle  responce,  etc.,  In  a- 
rapidly  changing  situation.  As  if  merely  determining  whether  or  not  there  is 
a  problem  isn't  enough,  corrective  action  normally  must  be  prompt  and  it  will 
depend  on  an  entirely  separate  set  of  circumstances.  Is  there  engine  damage 
or  is  it  just  a  simple  malfunction?  Is  thrust  needed  immediately  to  prevent 
ground  impact?  Is  the  aircraft  at  high  or  low  angle  of  attack?  Has  it 
departed  controlled  flight?  Is  someone  shooting  at  you? 

Through  use  of  a  modern  electronic  engine  display  we  can  get  critical 
information  fast.  First  of  all  the  display  can  get  our  attention,  it  can 
announce  the  stall  and  give  us  the  cause  if  known.  Following  this  warning 
function  the  display  can  then  list  the  options  available  to  clear  the  stall. 
Such  a  list  might  Include  just  waiting  or  a  shutdown  in  a  more  severe  case. 

If  shutdown  is  required  the  display  can  tell  us  to  either  restart  the  engine 
or  secure  it,  if  warranted,  by  engine  damage. 

Another  less  severe  problem  may  occur  when  operating  the  engine  very 
close  to  the  stall  line  when  an  engine  component  malfunction  occurs.  At  this 
point  the  engine  will  very  likely  stall  if  the  normally  available  options  are 
exercised  by  the  pilot.  In  this  case  the  display  could  warn  the  aircrew 
against  the  marginal  options  such  as  lighting  the  afterburner,  conducting 
high  altitude  slow  speed  flight,  or  reducing  engine  thrust  to  idle  in  certain 
regimes. 

In  both  cases  advanced  engine  displays  can  relieve  aircrew  of  the  need 
to  interpret  complex  problems  in  critical  situations;  they  can  alert  the 
pilot  and  provide  him  with  a  menu  of  corrective  actions.  All  this  can  be 
done  rapidly,  reliably,  and  automatically. 


Engine  Dlaolavs  In  Normal  Operation 

The  use  of  advanced  displays  Is  not  limited  to  off  nominal  operations. 
These  devices  will  provide  significant  improvements  in  the  transmission  of 
information  during  normal  operating  conditions  as  well. 

In  addition  to  the  information  available  from  current  analog  gauges, 
e.g.,  rpm,  temperature,  and  fuel  flow,  other  sophisticated  computer 
calculated  parameters  are  available.  A  modern  engine  display  could  provide 
the  pilot  a  direct  readout  of  thrust.  This  could  be  read  as  either  an 
absolute  value,  or  as  a  percentage  of  expected  thrust  for  ambient  conditions. 
For  cruise  tasks  the  display  could  also  provide  a  readout  of  specific  fuel 
comsumptlon. 

When  data  from  the  aircraft's  central  air  data  computer  (CADC)  Is  used 
in  conjunction  with  data  from  the  digital  fuel  control  even  more  Information 
could  be  made  available  to  the  pilot.  A  readout  of  specific  excess  power, 
specific  excess  power  per  unit  fuel  flow,  or  nautical  miles  per  pound  of 
fuel  could  all  easily  be  provided. 

An  Example  Display  Format 

By  now  you  have  gotten  the  Idea  that  the  electronic  fuel  control  can 
provide  a  real  wealth  of  Information,  but  the  question  now  arises  as  to  what 
kind  of  formats  we  may  have  In  modern  engine  displays.  Figure  1  is  a  naive 
pilot's  idea  of  a  modern  format. 

A  typical  modern  display  consists  of  a  cathode  ray  tube  (CRT)  with 
on-half  of  the  tube  dedicated  to  each  of  two  engines.  On  the  left  side  of 
the  tube  we  have  an  example  of  a  stagnated  engine.  The  display  clearly 
announces  the  condition  and  presents  the  values  of  three  key  engine 
parameters:  exhaust  temperature,  compressor  speed,  and  fuel  flow. 
Additionally,  the  fact  that  the  fuel  control  Is  attempting  to  maintain 
minimum  fuel  flow  to  clear  the  stagnation  is  annotated. 
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The  right  half  of  the  CRT  shows  a  normally  operating  engine.  A 
traditional  parameter,  fuel  flow,  is  shown  along  with  two  others.  Thrust  as 
well  as  specific  excess  power  are  displayed.  At  the  bottom  the  use  of  the 
fourth  airflow  trimming  schedule  (or  whatever  subroutine  the  engine 
controller  is  operating  in)  is  also  shown. 

Multi-Page  Format 

Within  the  automatic  program  available  with  the  advanced  engine  display 
a  multi-page  format  would  be  ideal  for  optimizing  both  the  amount  of  and 
rapidity  with  which  information  is  relayed  to  the  aircrew.  Page  one  would  be 
the  standard  performance  page,  as  exemplified  by  the  right-half  of  figure 
one. 


In  the  event  of  an  emergency,  page  two,  the  emergency  situation  page, 
would  automatically  supersede  the  on  condition  display  of  page  one.  This 
page  would  identify  the  off-nominal  condition;  and  then  the  DEEC  would  call 
up  for  display  the  immediate  action  emergency  procedures  to  oe  carried  out. 

Page  three,  the  diagnostics/health  page,  would  be  manually  selectable  by 
the  aircrew.  This  page  could  provide  a  variety  of  internal  engine 
parameters,  e.g.,  turbine-inlet-temperature,  various  pressures,  or  any  other 
raw  data  which  the  DEEC  might  know. 

It  is  important  that  the  engine  display  multi-page  functions  are 
automatic  as  much  as  possible  to  avoid  burdening  the  pilot  with  the 
requirement  to  switch  pages  in  an  emergency.  Manual  selection  of  page  three, 
however,  would  retain  the  flexibility  to  use  this  data  when  desired. 

Flight  Strategies 

By  now  the  use  of  a  digital  engine  control  coupled  with  an  advanced 
display  are  obvious  during  an  emergency  situation.  But  how  do  we  use  the 
display  during  normal  operation?  If  an  air  transport  type  flight  computer  is 
available,  the  electronic  fuel  control  cal  provide  additional  parameters  to 
provide  real-time  updates  to  the  computer,  thus  improving  on  the  performance 
of  these  useful  pieces  of  equipment. 


For  those  aircraft  without  a  flight  performance  computer,  the  electric 
fuel  control  can  provide  the  aircrew  with  a  comparison  between  different 
flight  strategies  to  accomplish  a  task.  For  example,  should  a  pilot  use  a 
higher  power,  less  efficient  fuel  setting  to  do  a  task  more  quickly  and  save 
fuel?  The  electric  fuel  control  can  make  a  variety  of  parameters  available 
and  over  time  aircrew  can  develop  a  feel  for  the  best  way  to  perform  a  given 
task. 

Hardware  Considerations 

Standard  modern  cockpit  display  hardware  should  be  adequate  for  these 
proposed  engine  displays.  No  extra  ordinary  requirement  for  reliability 
exists  for  engine  displays.  They  are  not  essential  for  safe  rfecovery  of  the 
airplane,  it  seems  likely  that  the  display  should  include  some  or  most  of 
the  logic  it  embodies,  and  also  contain  enough  processing  capacity  to  present 

basic  engine  data  in  the  event  of  failure  of  the  engine  electronic  control. 

Conclusion 

The  digital  electronic  fuel  control  coupled  with  an  advancea  engine 
display  provides  a  large  increase  in  the  amount  of  engine  performance 
information  to  the  aircrew.  These  displays  can  assist  the  aircrew  in  both 
normal  and  emergency  conditions  and  can  provide  optimum  performance  flight 
strategies.  Modem  display  hardware  could  easily  be  coupled  to  the  digital 
fuel  control. 
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OF  COMBAT  AIRCRAFT 


OVERVIEW  OF  THE  COLOR  DISPLAYS 
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1973  THE  FIRST  LXPERIMENTAL  COLOR  ELECTRONIC 
PANEL  FOR  AIRUNER  IS  PRESENTED  AT 
LE  BOURGET  1973  AIRSHOW 
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A  SUBSYSTEM  IS  SHOWN 


DISPLAY  TECHNOLOGY  AND  THE  ROLE  OF  HUMAN  FACTORS 


I 

STANLEY  N.  ROSCOE,  JON  S.  TATRO,  EDDIE  J.  TRUJILLO 

Behavioral  Engineering  Laboratory 
New  Mexico  State  University,  Las  Cruces,  New  Mexico 

i 

As  the  transition  from  electromechanical  flight  instruments  to 
multifunction  electronic  displays  gains  momentum,  human  factors 
engineers  are  not  well  prepared  to  provide  quantitatively  specific 
inputs  to  the  design  process.  In  the  years  we  have  been  doing 
flight  and  simulation  experiments,  we  have  not  developed  a 
I  sufficiently  comprehensive,  empirically  based  mode',  of  pilot 

performance  to  assure  effective  real-world  applications.  This 
situation  has  come  about  because  engineers  and  behavioral 
scientists  have  invested  too  much  of  our  experimental  resources  in 
comparative  evaluations  of  specific  devices  and  not  enough  in 
multi  factor  research.  To  develop  a  general  predictive  model  of 
I  pilot  performance,  the  effects  of  and  interactions  among  the  many 

display  and  control  system  variables  must  be  assessed  (Simon,  1977) 

Through  the  use  of  the  NAVSTAR  satellite  global  positioning 
system  (GPS)  in  combination  with  stored  maps  of  large  regions  of 
teri'ain  and  weather-penetrating  imaging  sensors,  it  is  now 
possible  to  provide  pilots  with  sufficiently  precise  position 
information  for  all-weather  instrument  flight  near  the  earth’s 
surface.  With  both  terrain  and  position  information,  on-board 
computers  can  drive  navigation  displays  with  dependable  flight 
command  information.  Such  a  system  has  been  developed  and 
successfully  tested  in  a  UH-1  helicopter  at  the  Yuma  Proving 
Ground.  In  that  test,  GPS  information  was  combined  with  stored 
terrain  profile  data  to  generate  desired  flight  commands.  This 
allowed  the  pilot  to  complete  several  mission  scenarios  success¬ 
fully,  including  terrain  following  (Woodward  and  Hoover,  1981). 

Such  advances  in  avionics  technology  have  made  possible  the 
implementation  of  several  basic  display  principles  that  were 
once  impractical.  However,  the  development,  evaluation,  and 
deployment  of  complex  systems  require  a  practical,  economical, 
goal-directed  approach  to  system  design  (Beringer  and  Roscoe, 

1980 ;  Hunt,  Howell,  and  Roscoe,  1972;  Roscoe  1982).  What 
direction  should  the  cockpit  designer  take?  What  approaches  are 
available  to  develop,  specify,  and  evaluate  new  cockpit  design 
principles?  A  program  at  New  Mexico  State  University’s  Behav’ iral 
Engineering  Laboratory  (BEL),  under  contract  with  the  US  Office  of 
Naval  Research,  has  taken  a  step  toward  demonstrating  a  holistic, 
multifactor  experimental  strategy  for  the  design  and  evaluation  of 
display  and  control  systems  (Tatro,  Corl,  and  Roscoe,  1983). 
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CONTEXT 


Vertical  takeoff  and  landing  (VTOL)  aircraft  have  not  reached 
their  operational  potential  during  all-weather  instrument  flight. 

A  portion  of  this  problem  can  be  attributed  to  the  inherent 
instability  of  the  VTOLs’  current  control  systems,  while  the 
remainder  of  the  problem  is  due  to  inadequate  flight  displays. 

Both  problems  are  being  addressed.  A  major  product  of  this  effort 
is  a  horizontal  display  for  vertical  and  translational  control 
under  all-weather  operational  conditions  (Roscoe,  Hull,  Simon,  and 
Corl,  1981;  Roscoe,  1982;  Tatro  et  al.,  1983).  The  display 
presents  Horizontally  and  VERticaliy  INteGrated  flight  control  and 
navigation  information  (hence,  the  HOVERING  display). 

This  research  effort  is  concerned  with  the  mutually 
compatible  integration  of  several  individually  developed  and 
validated  flight  display  and  control  design  principles.  Some  of 
these  so-called  "principles"  have  found  limited  application  in 
operational  systems.  More  often  system  designers  have  not  availed 
themselves  of  features  known  to  improve  pilot  performance  such  as 
reduced  orders  of  control,  flight-path  prediction,  display 
frequency  separation,  hybrid  compensatory  display  arrangements, 
and  dynamically  adaptive  control/display  sensitivity  logic. 
Evidently  they  have  perceived  such  features  as  too  costly  and 
risky  with  conventional  electromechanical  display  and  control 
technology. 

Despite  these  limitations,  throughout  the  1970s  and  early 
‘30s  the  Office  of  Naval  Research,  in  anticipation  of  techno¬ 
logical  advances,  has  supported  research  on  display  principles, 
first  at  the  University  of  Illinois  and  then  at  New  Mexico  State 
University,  to  put  together  all  the  good  old  ideas  that  were  once 
Impractical  in  a  systematic  way  for  potential  application  to 
helicopters  and  vectored-thrust  VTOL  aircraft.  Our  present 
problem  with  VTOL  airplanes  and  helicopters  is  how  to  take 
advantage  of  their  ability  to  fly  like  hummingbirds  in  the 
execution  of  low-speed,  low-altitude  missions  totally  beyond  the 
capabilities  of  fixed-wing  airplanes,  and  to  do  so  in  bad  weather 
and  at  night. 

The  objective  of  this  research  is  to  develop  a  multiple 
regression  model  of  helicopter  and  VTOL  pilot  performance  as  a 
function  of  a  large  number  of  critical  real-world  variables, 
including  mission  relevant  task  variables,  display  configuration 
variables,  and  display  dynamics  variables  for  a  rcraft  having 
variable  control  dynamics.  The  resulting  ge.ier.Jizable  display 
and  control  design  principles  will  provide  guidance  applicable  to 
aircraft  capable  of  vertical  as  well  as  translational  flight  with 
a  high  degree  of  maneuvering  independence  in  six  degrees  of 
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freedom.  As  technology  moves  rapidly,  30  must  research  if 
designers  are  to  be  guided  by  a  comprehensive,  objective  data 
base. 


SYSTEM  APPROACH 

To  achieve  this  goal  a  systi  t  approach  is  essential.  This 
requires  the  definition  and  determination  of  mission  requirements, 
delineation  of  system  requirements  and  constraints,  development 
and  comparison  of  potential  system  configurations,  production  of 
an  optimum  system,  and  its  deployment  and  evaluation  (Hunt  et  al., 
1972).  Such  a  task  calls  for  an  experimental  strategy  and 
techniques  not  commonly  employed  by  behavioral  scientists  (Simon, 
1976;  Simon  and  Roscoe,  1981).  The  development  of  BEL *3 
MicroGraphic  VTOL  Simulation  Facility  and  the  HOVERING  display 
provides  an  illustrative  example  of  this  approach. 


Mission  Requirements 


In  the  case  of  the  HOVERING  display,  mission  scenarios 
require  all-weather  instrument  flight  near  the  ?arth's  surface  in 
VTOL  aircraft  under  zero-visibility  conditions.  Instrumentation 
must  support  a  variety  of  mission  scenarios  including  shipboard 
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rescue  operations  over  rough  seas. 


and  point— to— point  hovering  and 


System  Requirements  and  Constraints 

Tho  simulation  facility  had  to  allow  manipulation  of  vehicle- 
model  characteristics,  display  parameters,  and  control  system 
dynamics.  The  simulation  had  to  enable  the  investigator  to 
explore  the  effects  of  as  many  potentially  important  real-world 
variables  as  necessary  to  model  pilot  performance  comprehensively. 


Potential  Configurations  and  Prototype  System 

A  conceptual  analysis  and  review  of  instrument  flight 
problems  in  piloting  VTOL  aircraft,  including  helicopters, 
preceded  the  development  of  a  generic  VTOL  simulation  and  the 
initiation  of  an  experimental  investigation  of  critical  design 
variables  in  forward-looking  and  downward-looking  tactical 
situation  displays  (Figure  1).  The  displays  themselves  are  large, 
flat  plasma  screens  on  which  computer-animated  contact  analog 
symbology  is  presented  in  real  time,  and  in  the  case  of  the 
downward-looking  display,  altitude  and  vertical  rate  information 
are  effectively  integrated  with  horizontal  positions  and  rates  to 
achieve  unprecedented  accuracy  and  stability  of  vertical  and 
transitional  flight  control. 
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Figure  K  Artist's  conception  of  BEL's  MicroGraphic  VTOL 

simulator,  including  the  centrally  located  HOVERING 
display  (Tatro  et  al.,  1983). 


SIMULATION  FACILITY 

In  the  DEL  MicroGraphic  VTOL  Simulator,  alongcourse  and 
crosscourse  translational  rates  and/or  accelerations  (depending  on 
the  mode  in  effect)  are  controlled  by  a  three-axis,  spring- 
centered  control  stick  mounted  on  the  right-hand  arm  rest  (see 
Figure  1).  Alongcourse  tracking  is  controlled  by  fore  and  aft 
stick  displacement  from  a  center  detent,  and  crosscourse  tracking 
by  left  and  right  stick  displacement.  Rotating  (twisting)  the 
sti"'"  about  its  vertical  axis  controls  the  vehicle's  yaw  (crab) 
angle  relative  to  the  horizontal  velocity  vector.  Vertical  flight 
is  regulated  by  a  vertical  speed  control  (VSC)  operated  by  the 
pilot's  left  hand.  The  VSC  is  spring-centered  and  viscously 
damped  and  is  operated  by  displacing  the  stick  upward  to  ascend 
and  downward  to  descend,  therby  serving  as  a  total-vertical-thrust 
control. 
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The  vehicle's  heading  in  the  horizontal  plane  is  displayed  by 
a  .’•otating  compass  rose  that  responds  to  both  crosscourse  controj 
inputs  and  weather-vaning  of  the  vehicle  due  to  the  effects  of 
relative  wind  (Figure  2).  A  turn-rate  index  line  is  shown 
relative  to  top-dead-center  of  the  display  so  that  a  desired 
heading  can  be  captured  by  matching  this  index  with  the  desired 
position  on  the  rotating  compass  rose.  Crosscourse  and 
alongcourse  rates  and/or  accelerations  are  displayed  by  a  position 
predictor.  For  vertical  flight  control,  the  information  provided 
by  the  HOVERING  display  includes  a  present  altitude  indicator, 
desired  altitude  goal  bars,  and  both  desired  and  actual  vertical 
rate  indicators  (Figure  3). 


Figure  2.  Current  configuration  of  the  HOVERING  display 
(Tatro  et  al. ,  1933). 


130 


Oetir#»d 
Vertical  Rata 
Field  Indicators 


Actual 

Vertical  Rate 
Field  Indicators 


I  '  I  '  1  ' 4000 


OVR  Superposed  on  VRI 


Figure  3.  Vertical  flight  information  provided  by  the 
HOVERING  display. 


The  present  altitude  indicator  is  an  octagonal  box  that 
dilates  as  altitude  increases  and  constricts  as  altitude 
decreases.  Altitude  (size  of  the  octagonal  box)  is  read  against  a 
fixed  scale  emanating  from  the  center  of  the  display  left  and 
right  to  the  momentary  limits  of  the  scale  ac  the  display's  outer 
edge.  The  scale  limits  automatically  change  by  a  ratio  of  to  1 
as  the  simulated  aircraft  ascends  through  the  momentary  limits  and 
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as  it  decends  within  the  limits  of  the  next  larger  scale. 

Altitude  goal  bars  (AGBs)  provide  an  indication  of  instantc  eous 
desired  altitude.  The  pilot's  task  is  to  keep  the  octagonal  cox 
aligned  within  the  altitude  goal  bars.  The  AGBs  and  the  octagonal 
altimeter  move  independently;  hence,  altitude  control  reduces  to  a 
basic  pursuit  tracking  task. 

Desired  vertical  rate-field  indicators  (DVRs)  consist  of  four 
sets  of  bars  that  flow  outward  to  display  desired  rate  of  climb 
and  inward  for  desired  rate  of  descent.  The  actual  vertical  rate 
indicators  (VRIs)  consist  of  four  sets  of  bars  superposed  on,  but 
perpendicular  to  the  DVRs.  The  flow  of  both  the  desired  and 
actual  vertical  rate  indicators  matches  that  of  the  octagonal 
altimeter;  outward  flow  indicates  a  desired  or  actual  rate  of 
climb,  and  inward  movement  indicates  desired  or  actual  rate  of 
descent. 


A  tradeoff  exists  between  the  presentation  of  the  "big 
picture"  (for  flight  planning  and  navigation)  and  display 
magnification  with  respect  to  tracking  error.  An  optimum  display 
would  somehow  present  the  pilot  with  the  "big  picture"  while  still 
preserving  the  necessary  sensitivity  to  allow  accurate  tracking. 
One  strategy  to  cope  with  this  tradeoff  has  been  to  provide  the 
pilot  with  a  number  of  selectable  display  modes,  some  of  which 
involve  altering  the  screen  scale.  However,  this  approach  has 
several  drawbacks. 


Providing  the  pilot  with  selectable  screen  scales  also 
provides  the  pilot  with  increased  workload  ("What  screen  scale 
shall  I  select?").  It  also  requires  the  pilot  either  to  switch 
back  and  forth  between  various  scales  or  select  some  middle-of-the- 
road  scale  that  provides  a  reasonable  sense  of  the  "big  picture" 
while  allowing  acceptable  tracking  with  some  compromises  in 
operational  capability.  Furthermore,  selectable  display  modes 
involve  more  switches,  and  this  takes  up  more  and  more  space  in  an 
already  overly  crowded  cockpit  (Dasaro  and  Elliott,  1981). 


One  alternative  to  the  typical  approach  might  be  to  provide 
the  "big  picture"  and  also  provide  a  sensitive  "vernier  deviation 
indicator"*^  to  allow  precise  tracking  (Roscoe,  1968a).  A  desired 
course  line,  next  hover  point,  and  distant  hover  point  were 
included  to  provide  the  pilot  with  the  "big  picture"  (Figure  4). 
The  screen  scale  for  the  big  picture  symbology  in  this  example  is 
equivalent  to  a  5  nmi  (1.5m)  radius.  The  positioning  logic  for 
the  target  cross  provides  a  vernier  (magnified)  instantaneous 
desired  position  indicator.  The  vernier  scale  for  the  target 
cross  represents  a  radius  of  250  feet  (V6m;  this  scale  can  change 
as  a  function  of  mission  requirements). 


The  HOVERING  display  has  several  desirable  features  in 
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display/control  relationships  for  translational  position  and  rate 
control.  A  target  or  desired  flight  path  is  acquired  by  placing 
the  predictor  on  the  target  cross  using  control  inputs  from  the 
three-axis  side-arm  control.  Although  the  display  is  basically  an 
inside-out  presentation,  the  display  has  frequency-separation 
characteristics  analogous  to  those  advanced  by  Roscoe  (1968b; 
Roscoe,  Johnson,  and  Williges,  1980)  for  aircraft  attitude 
indicators.  The  predictor  functions  as  an  immediate  indication  of 
control  inputs  (high-frequency  responses),  whereas  the  closure  of 
error  between  target  and  the  pilot’s  point  of  reference  responds 
more  slowly  (low-frequency  responses).  Once  a  target  has  been 
acquired,  the  predictor  should  be  kept  on  the  target  cross  as  it 
moves  toward  the  pilot's  point  of  reference. 
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Figure  4.  The  big  picture  and  the  precise  tracking  symbols 
in  the  HOVERING  display. 


EVALUATION  OF  THE  SYSTEM 


A  screening  experiment  was  conducted  to  evaluate  the  relative 
effects  on  pilot  performance  of  eight  display,  control,  and  flight 
task  variables.  Those  variables  tested  were:  tracking  mode 
(TM),  flight-path  prediction  time  (PT),  flight-path  prediction 
order  (PO^  magnification  factor  (MF),  control  gain  (CG),  control 
order  (CO),  vertical  gain  reduction  logic  (GR),  and  initial 
position  error  (IP).  Alongcourse,  crosscourse,  and  altitude 
tracking  errors  were  recorded  and  analyzed  using  Yates'  algorithm 
(Simon,  1977).  The  mean  differences  for  each  dependent  measure 
were  normalized  and  plotted  on  probability  paper  (Figure  5). 


Figure  5.  Example  of  a  normal-order  plot  for  alongcourse  tracking 
error  (Tatro  et  al.,  1983).  The  outlying  points  show 
which  factors  have  statistically  significant  and 
practically  important  effects. 
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Those  parameter's  found  to  be  most  important  are  being 
investigated  systematically  to  optimize  the  display  system  across 
several  flight  scenarios.  Among  the  parameters  found  most 
important  are  magnification  of  instantaneous  error,  control  order, 
tracking  mode,  control  gain,  prediction  time,  and  several  of  their 
interactions.  The  outcome  of  the  experiment  indicated  that  the 
HOVERING  display  and  control  system  is  a  positive  step  toward  all- 
weather  flight  in  VTOL  aircraft.  This  was  accomplished  by  the 
integration  of  the  basic  display  principles  mentioned  previously 
coupled  with  a  considerable  increase  in  control  stabilization. 
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ABSTRACT 

The  operational  use  of  pictorial  graphics  in  the  F-18's  stores  display 
sparked  discussion  between  Air  Force  and  Navy  crew  station  design  personnel 
regarding  the  long-term  potential  of  this  type  of  format  for  conveying  infor¬ 
mation  to  the  pilot.  Based  on  these  discussions,  the  joint  f’ictorial  Format 
Program  was  launched;  it  consists  of  three  phases:  format  development,  format 
evaluation  (single-seat),  and  format  evaluation  (two-seat).  The  first  two 
phases  are  now  complete,  and  the  third  is  just  beginning.  The  results,  so 
far,  indicate  that  pictorial  formats  are,  indeed,  an  efficient  means  of  por¬ 
traying  complex  information  to  the  aircrew. 

PAST 


Introducti  V  :i 

The  F-18  crew  station  is  a  dramatic  break  through  in  cockpit  technology. 
Cathode  ray  tubes  (CRTs),  hands-on-throttlc -and- stick  (HOTAS),  and  the  inte¬ 
grated  up  front  control  of  the  communication,  navigation,  and  identification 
(CNl)  functions  are  but  some  of  the  innovations  contained  in  the  F-18.  One 
feature  of  this  cockpit,  the  graphically  depicted  stores  (weapons)  layout, 
prompted  extensive  discussions  between  personnel  at  the  Naval  Air  Development 
Center  and  the  Air  Force's  Flight  Dynamics  Laboratory.  These  discussions  were 
the  genesis  of  the  Pictorial  Format  Program  (PFP).  The  primary  goal  of  the 
program  was  to  evaluate  the  potential  of  graphic  display  formats  beyond  those 
used  in  the  F-18.  Two  key  features  were  incorporated,  as  mandates,  into  the 
approach  of  the  research  effort:  creativity  and  advanced  technology. 

Creativity  was  emphasized  in  the  work  statement  by  encouraging  the  maxi¬ 
mum  use  of  pictorial  graphics  in  the  formats.  The  contractor  was  directed  to 
go  beyond  conventional  formats  such  as  those  portrayed  on  an  Attitude  Director 
Indicator  or  on  a  Horizontal  Situation  Indicator.  In  addition,  the  use  of 
alpha-numerics  in  the  formats  was  discouraged  unless  absolutely  necessary  to 
portray  the  information. 

The  contractor  was  to  assume  that  such  advanced  technology  as  full  color, 
sunlight  readable  CRTs  and  readily  programmable,  raster  symbol  generators 
already  existed.  This  assumption  may  not  seem  so  advanced  today  since  the 
Boeing  757/767  contain  multiple  color  CRTs,  and  the  F-15  is  beginning  to  in¬ 
corporate  them  into  its  cockpit;  however,  in  1978,  when  the  work  statement  was 
prepared,  these  teclinologies  were  still  at  the  laboratory  stage.  By  ex¬ 
ploiting  t.hese  advancements,  new  avenues  of  information  presentation,  such  as 
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In  May  ot  19b0,  a  contracl  was  awarded  to  McDonnell  Aircralt  (Corporation 
(MCAlR)  to  develop  the  initial  jiicturtal  lorinat.  concopts.  This  task  required 
production  ot  format;;  for  prim.try  flight,  Lat:t  ical  situat  ton,  stores  manage¬ 
ment,  navigation,  engines,  and  subsystem  munageiiren  t .  An  examplt'  of  a  tactical 
situation  display  is  shown  in  1 igure  1. 


Figure  1.  Artist's  Conception  of  a  Tactical  Situation  Display 


Lach  of  the  above  format  families  was  produced  in  throe  separate  ver¬ 
sions:  monochrome,  color  vector  graphic  (stroke),  and  color  raster.  The 
decision  to  produce  a  monochrome  version  was  based  on  the  consideration  of 
retro!  il  t  iiig  pictorial  formats  into  current  fight.er  aircraft,  none  of  which 
contained  a  color  CRl  (the  Mirage  is  an  exception  since  it  incorporates  a 
penetroii,  limited-color  CKT).  An  additional  reason  for  the  creation  of  this 
version  of  the  formats  was  that  comparisons  between  monochrome  and  color  ver¬ 
sions  of  the  formats  were  planned  for  the  fiituri;.  The  vector  graphic  version 
was  included  because  near  Lcrm  color  CR'l'  technology  projections  indicated 
that,  in  order  to  meet  the  sunlight  legibility  requirements,  stroke  writing 
would  have  to  he  utilized.  The  raster  version  was  based  on  a  longer  range 
projection  of  the  growth  ol  color  (IRT  technology.  Ry  including  all  three  ver¬ 
sions  of  the  formats,  technology  insertion  could  be  accomplished  whenever  the 
opport.unity  arose. 

The  products  of  this  eflort  (Tauei  and  ()uinn,  1981  a,  b;  1982)  have  been 
widely  distribuH^d  and  have  tieeii  preseiiied  at  various  technical  meetings 


138 


(Reising  and  Kmcison,  1982).  iJased  on  Lho  discussions  generated  by  these 
results,  whicli  became  rather  heated  at  times,  it  can  be  concluded  that  the 
first  phase  ol  the  FFP  program  achieved  its  goals.  Specifically,  the  basic 
concept  and  use  ol  pictorial  graphics,  especially  those  using  color,  to  por¬ 
tray  cockpit  information  was  viewed  as  good.  I’he  intense  discussions  centered 
almost  exclusively  around  detailed  design  questions  rather  than  the  utility  of 
the  pictorial  format  as  a  medium  of  information  transfer. 
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Pictorial  Format  la’ul  nation 


The  second  phase  in  the  PFP  was  to  evaluate,  through  simulation,  the  con¬ 
cepts  developed  in  the  1 i r st  phase  of  the  program.  The  overall  pliilosophy  of 
the  Pictorial  Format  F,val  nation  phase  of  t.he  program  was  to  use  real  hardware 
to  create  a  single-seal  cockpit  in  which  the  pictorial  formats  would  operate 
dynamically.  The  cockpit  is  located  in  the  simulation  facilities  of  the 
Boeing  Military  Airplane  Company  (BMAC),  the  winner  of  the  evaluation  phase  of 
the  program.  Although  it  contains  some  residual  electro-mechanical  displays, 
it  is  essentially  an  all  electronic  cockpit.  The  key  feature  of  this  cockpit 
is  the  availability  of  five  CRTs  to  portray  information  to  the  pilot.  Figure 
2  shows  an  example  ol  one  of  the  formats  displayed  in  this  cockpit. 


Figure  2.  Computer  Generated  Tactical  Situation  Display 


A  loial  ol  30  Am  I'otiu  aiitl  Navy  pilots  pai  1. 1 1.  i  paH'd  in  I  (il‘  siinulaUan 
ovaluaLions.  liat  li  pilot  llow  a  cuiiii)osj  t  c  mission,  which  included  boili  uit-lo- 
a  M-  anc'  ai: -l  o-^ruuiul  si'^nicuts,  i  liroc  t  inios — once  witli  each  ol  Lliree  vetsions 
ol  the  loMiiaUs.  I  he  jiilots  Inui  to  naviyat.e,  lly  i  lie  aircrafl  during  ci'riain 
mission  phast's,  si't  u|)  weapons,  handle  eiiiet  gene  n-s ,  and  avoid  pop-up  tlueais. 
The  mission  was  very  deihand  ing  tor  a  single-seal  ligliLer,  but  was  del  lbi,‘:  al  I'l  v 
designed  ro  be  ditticuli  so  thaL  any  difii'tences  in  perlormanee  while  using 
the  three  typi's  ot  lorinats  could  be  found. 

Iher;'  were  ii  nunibei  of  impoitant  lessons  Ir'arned  t  i  oni  this  t'Moit.  Tlie 
lust  of  wliicb  IS  tbat,  if  Llu'  pictoriaL  lormats  are  earelully  designed  as 
usable  monochromi'  displays,  the  addition  ol  color  iloes  i.  it ,  in  rnanv  cases, 
result  in  <i  signilicant  per  foi  iirance  improvoinent .  C'.omplc'x,  dynamic  formats, 
such  a.s  tlioHc'  appearing  on  a  Tactical  Situation  Display  (TSD)  jirovo  to  be  an 
exception.  In  this  situation,  the  pilots  were  able  to  pick  out  signi f iranl 1 v 
moil'  poi)-up  threats  wit.h  the  color  display.  Hie  second  majot  finding  is  that 
the  pilots  overwhelmingly  iin-fi't  color  dispJ.iys,  and  that  color  laster  is  pre- 
Ic'rrc'd  over  color  vector  graphic. 

Ill  House  Kc'si'arch 

These'  Phase  11  tindings  are  not  only  true  ol  the  intra-pictorial  display 
1 ormut  evaluation,  but  are  also  common  to  intei -di splay  format  research.  The 
pictorial  displays  developed  in  Phase  1  ot  this  el  fori  were  evaluated  in  per¬ 
formance  studies  conducted  at  the  Migfit  Dynamics  Laboratory  wiiere  they  wc-re 
compared  against  alphanumeric  displays  <iiid  voice  presentation  of  the  same  in- 
lormatton.  The'  first  of  those  studies,  (Aretz,  Reising,  Calhoun,  and  Herron, 
1983)  compared  t  lie  effect  i  venc-ss  of  alphanumeric,  monochrome  pict  cr  ial  formats 
and  color  pirtoriaJ  tornuits,  as  well  as  a  combination  ot  alphanumeric  and 
color  pictorial  lormats  in  portraying  weapons  status.  The  objective  results 
indicated  that  pilots  portorined  equally  well  with  the  alphanumeric,  color 
pict.orial  and  the  combination  ol  alphanumeric/color  pictorial  formats,  with 
performaiice  on  the  black  and  white  pictorial  formats  being  significantly  worse 
than  the  others.  The  most  significant  finding  ot  this  experiment  was  that 
i:olor  pictorial  formats  can  provide  an  enhanced  capability  for  "situational 
awareness"  especially  when  combined  with  alohanumcrics.  This  is  because  pic- 
t.ures  integrate  for  the  pilot  several  pieces  of  information  into  a  single 

chunk,  allowing  him  to  retrieve  important  inlormation  at  a  glance.  Again,  the 
value  of  color  pictorial  lormats  for  complex  displays  was  validated.  But 

because  the  data  was  not  strongly  conclusive  in  favot  of  the  pictorial  presen¬ 

tation  of  information,  other  .'Studies  were  designed  to  see  how  and  where  those 
lormats  could  best  be  used. 

A  Idllow-uiJ  study  focused  in  on  the  effectiveness  of  pictorial  present.a- 
tioris  during  controlled  tincl  uncontrolled  time  durations  (Stolling.s,  IDS'!*). 

Ihe  results  of  thus  study  indicated  that  <iolor  pictorial  formats  were  a 
superior  coding  method  in  situations  requiring  complex  information  retrieval 
during  short  duration  exposures  (approximately  100  msec).  The  color  formats 
were  significantly  better  than  both  alphanumeric  and  monochrome  pictorial  for¬ 
mats  . 

Anot.her  study  (Hawkins,  Kcising,  l.izza  and  Beachy,  1983)  compared  the  use 
ol  alphanumeric,  jnctoriaJ,  and  voice  presentation  ol  emergency  not i 1 icat ions 
and  ptocedure.s.  In  t.his  .study,  pictures  did  not  prove  to  be  better  than 
either  text  or  voice.  Even  thougli  pilots  were  throughly  briefed  on  their 
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meaning,  some  ol  the  lurmat.s  appai  imU  I  y  lequiiecl  i  nLc'r  pi  cl  at  i  on  ]h  ior  to 
ai  i  itin,  wlu'icas  voit  i'  aiul  a  1  [iliamiiiKM  i e  prest'nial  ion  did  not.  On  a  closoi 
look,  11  was  noU'd  t.hat  some  of  i.lie  lormals  needed  work.  For  instance,  the 
electrical  tormat  was  identilied  as  being  too  cluLLeied  and  the  liydraulics 
di.s])lay  format  was  not  as  intuitive  as  initially  thought.  Although  the  objec¬ 
tive  data  analysis  dotes  not  seem  to  support  the  investigators  strong  ieeltngs 
that  pictutes  tire  a  tar  hetti'i  and  taster  pr  t'seni  ,it  ion  inotle,  subjettivt'  [ire- 
lerence  supports  the  continued  explortiLion  of  color  pictorial  displays. 

I'uturi'  Dirc'c  l  ion 

Ihus  far,  t.he  pictorial  formal  work  has  only  begun  to  expose  the  tip  of  the 
iceberg.  Iht'  results  of  the  Phase  II  and  the  in-house  evaluation  study  have 
piovidetl  limited  validalion  fur  the  hyiiotheses  that  gcMU'rati'd  the  Pictorial 
format  research  efloits.  That  is,  pictures  improve  information  transt or  capa¬ 
bility  and  in  turn,  will  c'lihance  the'  pilot's  operational  [ler  1  ormance .  It  is 
hoped  that  some  of  t  tie  (|uestioiis  gcuic'iated  by  the  results  to  date  will  be 
answered  by  I’fuise  JJl.  In  additicui,  the  two-seat  Lighter  has  brought  new 
cfuestions  to  the  forefront.  Tliose  questions  address  the  need  for  dilfeient 
types  of  infoimation  displays  than  have'  pre-viously  been  developed.  In  addi¬ 
tion,  a  whole  new  problc'm  of  crew  coordination  of  tasks  and  tlie  information 
required  to  do  those  tasks  presents  itsc'll.  In  response  to  these  new  require¬ 
ments,  Phase  111  of  t  lu'  Pictorial  format  Program  is  just  now  beginning.  This 
e'ffort,  which  is  the  Mullicrew  I’lcloriai  format  Phase  of  t  hi'  Pf'P,  will  include 
development  and  I'valuation  ol  pictorial  format  displays  which  include  concepts 
a|)plieable  to  the  two-seat  fighter  cre'w's  requirements.  The  23  monl.h  contract 
tor  I'hasc  111  has  been  awarded  to  the  Boeing  Military  Aircraft  Company, 
Mcattle.  ]  t  be'gan  1  May  1^JB4  .ind  is  a  iiiul i  — sec 1 1 onc'd  e'ffoit. 

'1  he  overall  objective  ot  this  third  phase  of  the  program  is  to  again 
assess  the  usabiln.y  and  act  c'ptahi  1  i  t  y  of  pictorial  formats  in  conveying 
system  status  informal  ion  in  the  cockpit  ,  with  particular  emphasis  placed  on 
the  second  c  rewmembet  and  crew  ini.c'raction .  The  technical  approach  will  be 
similar  i.o  the  one  used  in  th.i'  Phase  11  c'ffort;  both  monochrome  and  color  ver¬ 
sions  of  each  lormat  will  be  evaluated.  In  Phase  111,  special  cinfihasis  will 
lie  [ilaced  on  resjiondlng  to  the  oper.itional  needs  of  the  Air  force  and  Navy 
aircrews,  tine  ot  the  major  intents  ot  the  study  is  to  insure  aircri'w  involve¬ 
ment  throughout  the  develojimciu  and  evaluation  of  the  pictorial  format.s. 
Aircrew  inputs  and  suggi’st  ions  will  he  sol  veiled  through  both  questionnaires 
and  by  stiuctured  im.erview.  llopeiully,  this  early  and  (onttnued  interaction 
with  the  usei  ,  will  bring  about  more  lealistic  lormats  and  facilitate  conti¬ 
nuity  as  this  technology  transitions  into  the  cockpit. 

Ihe  simulation  will  ulili^te  both  the  fore  and  aft  t  row  stations  of  the 
a  I  I -e !  ec  i.i  oiu  c  cockpit  u.seil  to  initially  evaluate  the  pictorial  lormats. 
Mission  scenarios  will  he  developed  to  highlight  crew  interaction  with 
advanced  lontiol  and  display  loiici'pts.  '1  lie  mission  will  include  air-to-ground 
and  aii-to-.iir  segments  which  involve  the  use  ot  pictorial  formais  lor  flight, 
situation  awareness,  systems  status  fi.e.,  engine,  fuels,  t'tc),  emergency 
notil  leal  ion  and  proci'dures,  and  n.ivigation.  Iheso  displays  will  be  based  on 
th.e  previous  wank  in  the  Picimi.il  foimat  development  and  the  I’hasi'  II  modili- 
cations  to  those  loMiials.  Ni'w  display  formats  will  bo  developed  based  on 
futuie  mission  requirements  and  tlu'  necessaiv  tailoring  ol  existing  lormals  to 
the  two-seat  eiiv  i  t  onment .  Spec  l  f  j  ca  1  1  y  ,  tlu'se  formals  will  lOiueilirali'  on 
taigei  and  waypoint  pieviewing,  ilueat  n'sjionse,  a'ul  sums  nianageiiient  . 


Several  levels  ol  evahialioii  ot  the  loriiiaLs  will  be  eop.d  ue  Led .  The  |)ie- 
liiiunaty  evaluaLiuns  will  serve  as  a  quality  cheek  on  the  piclorial  loimaL 
de  ve  I  upmeiil  .  Uesigii  symlKilogy,  loiUiiiuity,  todiiig  qualities  and  other  inior- 
niaLion  Lranslef  aspi'c  Ls  will  he  iulorriially  evaluated  Lo  assess  ilu'  overall 
lornuu.  readahtliLy  arid  utility. 

The'  lornial  evaluation  will  he  based  on  the  [ter  tormaiiee  ol  sixteen  air¬ 
crews  as  Lhey  each  fly  the  iiussions  Lwree — once  with  monochroine  forintiLs  in  the 
cock])LL  and  orv.e  with  Lhe  color  vi'tsions.  This  section  ol  Phase  Ill  will 
iiietisuie  their  perlotniance  on  mission-oriented  parameters  and  of  1  ecti  vc'noss 
indices.  The  ease  with  which  the  crew  can  call  uj)  the  forinats  will  also  be 
examined.  The  cockpit  will  allow  voice  ciintrol  .is  well  as  manual  operation  o( 
t.lie  various  switching  luncttuMis  during  the  missions  which  will  allow  an  in- 
vr'SLigtition  ol  the  reltitive  utility  ol  these  combined  conceins. 

Itic  filial  portion  oi  Phase  111  will  locus  on  formal  revision  based  on  the 
performance  data  and  subjective  evaluation  in  the  testing  and  data  collection 
Si'Ctions.  A  fintil  teclinic.tl  report  will  he  preptired  docunu'nt  ing  the  entire 
evaluation  program  including  results  and  i  t’coniniended  format  revisions.  How¬ 
ever,  the  most  import.int  step  will  hi'  the  transition  of  the  evaluated  concepts 
into  two-seat  Air  Force  and  Navy  aircraft  sucli  as  the  F-13  Dual  Role  Fighter, 
and  the  1-14  and  A-6  through  their  update  progr.inis. 

CONCLUSIONS 

ihe  missions  of  the  1990's  will  place  a  tremendous  burden  on  the  informa¬ 
tion  processing  capabilities  of  the  crew — tor  both  single-  and  two  scat 
aircralt.  It  is  crucial  that  information  be  displayed  in  a  form  which  is  easy 
and  natural  for  the  ert'w  to  iuLcrptt't.  As  the  pictorial  format  research  con¬ 
tinues,  w('  learn  more  about  how  and  where  pictures  can  be  used  to  enhance  the 
aircrew's  performance.  Their  application  appears  to  be  most  effective  in  very 
complcrx  dynamic  displays.  The  rcisiilts  of  research  perfotmetd  over  the  last 

tour  years  indicate  that  pictorial  formats  are  an  effective  means  for 

achieving  this  goal. 
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ABSTRACT 


A  flight  test  program  was  conducted  to  demonstrate  enhancement 
of  pilot  performance  flying  zero-zero  conditions  using  the 
integrated  Command  Flight  Path  Display  (CFPD).  The  CFPD  concept 
requires  minimal  training  for  both  IFR  experienced  and  limited 
experienced  pilots,  compared  to  the  training  required  when  using 
conventional  symbology.  This  enhancement  is  accomplished  by 
providing  attitude,  altitude,  direction  and  speed  commands  to  the 
pilot  in  the  form  of  an  electronically  generated  presentation  of  the 
real  world  flight  path  which  should  be  flown.  During  the  flight 
test  program,  the  performance  of  the  pilots  was  measured 
subjectively  through  video  recording  of  the  Vertical/Head  Up  Display 
presentation.  Objectively,  the  performance  of  the  pilots  was 
measured  through  digital  data  recordings  of  their  inadvertent 
diversions  from  a  mean  flight  path  related  to  the  presentation 
displayed  on  the  Vertical/Head  Up  Displays. 


Program  Objectives 


Objective  -  The  Naval  Air  Development  Center  sponsored  the 
program  with  the  overall  objective  of  proving  the  validity  of  the 
Command  Flight  Path  Display  (CFPD)  concept  during  actual  flight 
under  simulated  zero-zero  weather  conditions.  The  Command  Flight 
Path  Display  concept  consists  of  a  totally  integrated  pictorial 
presentation  of  the  fundamental  information  necessary  to  effectively 
perform  all  normal  basic  flight  operations  with  or  without  reference 
to  the  real  visual  world. 


The  specific  objectives  of  the  program  were: 


1.  To  demonstrate  during  actual  flight  that  the  CFPD  was  in 
fact  a  truly  integrated  display  which  provided  the  pilot 
with  adequate  information  to  execute  takeoff,  climb, 
cruise/navigation,  approach  and  landing,  without  reference 
to  conventional  parametric  displays. 


To  establish  that  pilot  performance  with  the  CFPD  was 
enhanced,  demanding  minimal  concentration  on  the  display, 
minimizing  inadvertent  departures,  and  requiring  minimal 
training  time,  both  initially  and  for  maintaining  flight 
proficiency,  as  compared  to  performance  utilizing  standarl 
symbolic  displays. 


3.  To  prove  that  the  electronic  system  required  to  generate 
the  CFPD  could  be  achieved  by  modifying  current  aircraft 
display  and  control  systems  through  the  utilization  of 
computer  graphics  picture  processing  techniques. 


HISTORY 


The  Command  Flight  Path  Display  is  the  result  of  approximately 
35  years  of  various  research  and  development  programs  sponsored  by 
the  Navy  in  an  effort  to  establish  an  optimal  man-machine  systems 


i nterf ace. 

The  concept  of  a  completely  integrated  pictorial  display  for 
aircraft  was  originally  conceived  in  1946  as  a  result  of  a  study 
performed  by  the  Flight  Section,  Special  Devices  Division,  Navy 
Office  of  Research  and  Inventions,  in  conjunction  with  the 
University  of  Illinois. 

It  should  be  emphasized  that  in  1946,  and  for  many  years  after, 
there  was  no  known  means  for  displaying  the  concept. 

In  1952  the  Office  of  Naval  Research  was  charged  by  the 
Assistant  Secretary  of  the  Navy  for  Air  to  establish  a  program  with 
the  Bureau  of  Aeronautics  to  develop  a  new  concept  for  aircraft 
instrum.entation.  This  program  was  originally  a  Navy  effort 
conducted  jointly  by  the  Office  of  Naval  Research,  Air  Branch,  the 
Bureau  of  Aeronautics,  Instrument  Branch,  and  the  Naval  Air 
Development  Center.  Later,  the  Army  joined  the  program  because  of 
its  interest  in  improving  helicopter  instrumentation  at  which  time 
it  was  named  the  Army-Navy  Instrumentation  Program  (ANIP) . 

The  generalized  a ircra f t/man-machine  system  was  identified. 
Although  ANIP  sponsored  work  in  each  of  the  system  areas,  those  of 
the  central  computer  and  displays  received  the  most  concentrated 
research.  However,  the  technology  was  still  not  available  to 
produce  the  required  display. 

Many  of  the  advanced  systems  now  installed  in  current  Navy 
aircraft  came  about  as  a  result  of  the  effort  of  this  program  which, 
over  a  ten-year  period,  produced  the  first  airborne  digital  central 
computer,  improved  cathode  ray  tubes,  and  initiated  the 
practicability  of  microelectronics.  All  of  these  advances,  when 
properly  integrated,  resulted  in  the  initial  demonstration  of  the 
concept  of  a  computer  graphics  generated  display  which  was  produced 
by  General  Electric  under  an  ANIP  contract. 

It  was  not,  however,  until  1972-73  that  computer  graphics 
reached  a  point  where  real  time,  realistic  computer  generated  images 
utilizing  relatively  small  computers  was  achieved. 
break-through  in  technology  was  presented  for  the  first  time  to  the 
Navy  at  the  First  Advanced  Aircrew  Display  Symposium  held  at  the 
Naval  Air  Test  Center  (NATC),  April  18-19,  1974. 

As  a  result  of  the  NATC  demonstration  and  interest  indicated  by 
DC?-JO  (AIR),  Naval  Air  Systems  Command  (NAVAI R3YSC0M )  through  the 
Naval  Air  Development  Center  (NADC)  sponsored  a  study  to  investigate 
the  feasibility  of  generating  a  pictorial  display  employing  real 


time  computer  graphics  techniques.  "me  study  produced  a 
demonstration  by  'Jorthrop  Aircraft  Division  in  a  flight  simulator  of 
the  original  concept  of  pictorial  displays  developed  under  the  ANIP 
p  rogr am . 

Previous  research  and  development  efforts  had  clearly 
established  visual  display  requirement  information  and  the  technical 
means  for  generating  the  displays.  T>ie  only  remaining  unknown  in 
proving  the  concept,  currently  referred  to  as  the  Command  Flight 
Path  Display  (CFPD),  was  whether  or  not  improved  flight  performance 
could  be  achieved  during  actual  flight  under  real  or  simulated  IPR 
flight  conditions. 

On  20  April  1982  authorization  was  given  by  the  Naval  Air 
Systems  Command  to  proceed  with  Phase  I  of  the  CFPD  program 
utilizing  the  tJ.3.  Air  Force  NC-131H  Total  In-Flight  Simulator 
(TIPS)  aircraft  for  installation  and  flight  testing  of  the  CFPD 
system. 

The  CFPD  Program  organization  consisted  of  the  following 
participants; 

•  Naval  Air  Systems  Command  -  Program  Manager 

•  Naval  Air  Development  Center  -  Technical  Program  Manager 

•  System  Associates,  Inc.  of  CA  -  Project  Manager  and  System 
Design  Coordinator 

•  Intermetrics  -  Softv/are  and  Data  Reduction 

•  Arvin/Ca J.span  -  Installation  of  the  CFPD  in  the  TIPS 
aircraft  and  flight  test  operations. 


Display  Concept 

The  Command  Flight  Path  Display  Concept  is  defined  as  a 
pictorial  presentation  of  totally  integrated  real  world  visual  cues 
which  provides  the  pilot  of  an  aircraft  with  the  following 
information : 

Orientation  -  Where  am  I  and  what  am  I  doing? 

Director  -  What  should  I  do  and  when? 

Quantitative  -  How  am  I  doing? 

All  three  categories  of  information  are  presented  relative  to 
the  real  world  vertical  plane  on  a  CRT  called  the  Vertical  Situation 
Indicator  (VSI),  and  relative  to  the  real  world  horizontal  plane  on 
a  CRT  called  the  Horizontal  Situ^ition  Indicator  (hSI). 


The  Vertical  Situation  Display  Format  should  be  displayed  on  a 
HUD  or  on  a  panel  mounted  CRT  VSI,  consists  of  the  following  three 
independent  elements  (Figure  1); 

a.  A  dynamic  earth  plane  or  "contact  analogue"  composed  of 
external  reference,  linear  perspective,  texture,  size  and 
shape,  and  motion  parallax  visual  cues,  with  the  capability 
of  angular  and  linear  displacement  relative  to  all  three 
a  xes . 

b.  A  dynamic  flight  path  composed  of  the  same  visual  cues  as 
the  contact  analogue  and  with  the  same  six  degrees  of 
f  reedom . 

c.  A  command  velocity  indicator  displayed  as  a  three 

dimensional  aircraft  located  by  pilot  selection,  either  to 
the  left,  right  or  center,  placed  above  or  below  relative 
to  the  flight  path,  and  with  the  capability  of  changing  in 
size  and  perspective  as  the  pilot  alters  his  formation 

position.  (During  this  flight  test,  the  velocity  indicator 
was  positioned  150  feet  above  the  Command  Flight  Path  for 
standardization  of  test  results. ) 

The  Horizontal  Situation  Display  Format  is  always  displayed  on 
the  HSI  which  should  be  oriented  to  the  horizontal  plane.  The 
format  consists  of  the  following  elements  (Figure  2); 

a.  A  topographical  m.ap  or  tactical  plot  depending  upon  the 

type  of  mission  being  conducted  is  provided  covering  the 

operational  area  of  the  aircraft  including  terrain 
characteristics,  potential  obstacles,  navigational  aid 
locations,  operational  bases,  destinations,  and  targets. 

b.  A  geographical  Command  Flight  Path  indicating  the  proposed 
or  altered  flight  plan  including  all  segments  and  way 
points,  the  aircraft  shadow  representing  present  position 
relative  to  the  flight  path,  an  indication  of  where  the 
aircraft  should  be  on  the  flight  path,  and  an  ellipse  which 
indicates  range  remaining  relative  to  present  power, 
altitude  and  velocity. 

In  the  test  program  both  displays  v/ere  included,  but  emphasis 
was  placed  on  the  Vertical  Situation  Display  with  the  HSI  providing 
only  the  geographical  Command  Flight  Path  and  the  aircraft  position 
relative  to  the  Command  Position.  The  program  objective  was  more 
directed  to  determining  the  ability  of  the  pilot  to  fly  the  aircraft 
effectively  under  IFR  conditions,  particularly  with  respect  to 
take-off  and  landing,  and  normal  flight  operations  rather  t’^an 
tactical  missions.  The  above  in  brief,  describes  the  overall  nasic 
Command  Flight  Path  concept. 


Situation  Display 
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In  meeting  the  program  objectives  of  concept  demonstration,  the 
CFPD  system  design  utilized  a  large  degree  of  commercial 
"off-the-shelf"  equipment.  In  fact,  only  the  inertial  navigation 
platform  and  diffraction  HUD  were  militarized.  This  design  decision 
enabled  relatively  rapid  acquisition  of  the  CFPD  hardware.  In 
addition,  the  high-level  software  development  environments  available 
on  the  commercial  equipment  provided  quick  turnaround  on  systeiii 
software  modifications  and  supported  a  high-level  of  productivity. 

'The  commercial  components  of  the  CFPD  system  were  hardened  and 
vibration  tested  prior  to  installation  in  the  aircraft.  The  system 
was  operational  for  over  ninety  hours  of  ground  based  simulation  and 
over  twenty-three  hours  of  flight  time.  The  only  hardware 
malfunction  from  the  start  of  simulation  was  in  the  HUD. 

The  CFPD  system  installed  in  the  TIPS  aircraft  is  diagrammed  in 
Figure  3.  The  key  element  in  the  system  was  the  Evans  &  Sutherland 
PS-300  graphics  system.  This  component  provided  all  image 
generation  and  transformation  functions  for  simultaneous  generation 
of  the  VSD  and  HSD  formats.  The  remainder  of  the  system  was 
composed  of  a  DEC  PDP-ll/44  mini-computer  and  associated  peripherals 
(digital  tape  drive,  data  acquisition  subsystem,  and  hardcopy 
termi nal ) . 

The  software  com.ponent  of  the  CPFD  system  provided 
aircraft-related  sensor  signal  processing  for  navigation,  simulation 
and  test  support,  and  data  recording,  in  addition  to  display 
generation  of  both  F/A-13  symbology  and  CFPD  formats.  This  software 
consisted  of  approximately  20,000  lines  of  FORTRAN  code  and  1,000 
lines  of  PS-300  display  program.  The  PDP-11  software  executed  using 
a  commercial,  real-time  operating  system  (RSX-llS,  Version  4.0)  and 
required  about  80K  bytes  of  memory. 


Flight  Test  Plan 

The  procedure  for  validating  the  CFPD  concept  consisted  of 
comparing  the  flight  performance  of  a  number  of  pilots  having 
different  degrees  of  experience,  while  flying  a  specific  flight 
plan,  first  utilizing  a  slightly  modified  current  F/A-18  discrete 
symbol  display,  followed  by  flying  the  same  flight  plan  with  the 
command  flight  path  integrated  pictorial  display. 

The  measure  of  the  subject  test  pilots'  performance  was  based 
upon  the  number  and  magnitude  of  inadvertent  departures  from  t>;e 
prescribed  flight  plan  which  were  recorded  relative  to  the  three 
flight  axes  plus  velocity  control,  when  flying  each  type  of 
display . 


These  procedures  were  performed  first  with  VS  I  and  HSI  displays 
with  the  test  cockpit  windows  completely  covered  with  translucent 
material  to  simulate  zero-zero  conditions,  and  then  followed  by 
replacing  the  VSl  with  the  Hughes  AIDS  HUD  and  repeating  the 
procedures  under  acceptable  actual  minimal  weather  conditions. 

The  flight  test  pattern  consisted  of  a  modified  instrument 
flight  training  pattern  composed  of  a  series  of  interrelated 
maneuvers  and  performances  basic  to  normal  instrument  flight  rule 
(IFR)  flight. 

The  entire  prescribed  flight  pattern  was  programmed  to 
establish  a  virtual  air  space  3000  feet  deep,  covering  approximately 
27  square  miles  with  a  perimeter  of  roughly  80  miles.  Since  the 
pattern  segments  and  way  points  were  fixed,  the  coordinates  could  be 
oriented  relative  to  any  heading  and  barometric  level  selected. 

In  addition  to  the  modified  instrument  pattern  each  pilot  was 
required  to  fly  actual  ILS-coupled  approaches  at  Niagra  Airport 
utilizing  both  display  formats. 


Results 


The  results  of  the  flight  test  data  were  significant.  The 
following  table  of  CFPD  flight  test  statistics  summarizes  the 
average  lateral  and  altitude  deviations. 


CFPD  Flight  Test  Statistics 

PATTERN  APPROACHES 


CFPD 

SYMBOLOGY 

CFPD 

SYMBOLOGY 

Lateral  Dev'iation  (ft) 

Max 

1081 

7017 

410 

968 

Mean 

121 

1267 

39 

345 

Time  Within  Lateral 
Deviations  (%) 


<75* 

52.  1 

11.4 

71.4 

23.4 

75-150* 

25.9 

10.4 

13.9 

17.  3 

150-1000* 

21.0 

42.  1 

14.  1 

51.1 

.  5 


>1000' 


.9 


36.1 
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PATTERN  APPROACHES 


CFPD 

SYMBOLOGY 

CFPD 

SYMBOLOGY 

itude  Deviation  (ft) 

Min 

-64 

-298 

-25 

-191 

Max 

510 

502 

255 

338 

Mean 

144 

51 

99 

70 

Range 

574 

800 

279 

529 

The  analysis  of  all  data  generated  the  following  conclusions 
relative  to  the  objectives  of  the  CFPD  program: 

a.  Objective  1  -  Flight  test  results  demonstrated  during 

actual  f 1 ight  that  the  CFPD  was  a  truly  integrated  display 
which  provided  the  pilot  with  adequate  information  to 
execute  take-ofl;,  climb,  cruise/navigation,  approach  and 
landing,  without  reference  to  conventional  parametric 
displays,  or  the  real  world. 

b.  Objective  2  -  Analysis  of  the  operational  plots  fully 
establish  that  pilot  performance  with  the  CFPD  was 
enhanced,  demanding  minimal  concentration  on  the  display, 
minimizing  inadvertent  departures/  and  definitely  requiring 
minimal  training  time  (total  training  time  prior  to  flight 
was  one  half  hour  with  the  CFPD),  both  initially  and  for 
maintaining  flight  proficiency,  as  compared  to  performance 
utilizing  standard  symbolic  displays. 

c.  Objective  3  -  The  program  results  proved  that  the 
technology  required  to  generate  the  CFPD  was  available  and 
could  be  integrated  into  current  aircraft  display  and 
control  systems. 

In  addition  to  meeting  the  objectives  '•f  the  program, 
considerable  knowledge  was  gained  relative  the  fundamental 

concepts  of  the  Command  Flight  Path  Display.  The  significant 
conclusions  are  as  follows: 

a.  The  concept  of  continuous  command  information  is  perhaps 
one  of  the  most  significant  innovations  that  the  CFPD 
foriTiat  provides  to  man-machine  systems  displays.  By  having 
this  information  available,  the  necessity  for  memorizing 
each  segment  of  the  mission  flight  plan,  or  even  referring 
to  a  navigation  chart,  is  eliminated. 
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b-  Another  concept  inherent  in  the  CFPD  format  is  the 
requirement  for  an  integrateii  (iispLay  in  lieu  of  combined 
discrete  symbols-  Since  the  word  "symbol",  by  definition, 
is  "something  that  stands  for  or  represents  another  thing", 
it  follows  that  symbols  require  interpretation.  and 
interpretation,  in  turn,  requires  a  learning  process 
followed  by  mental  integration- 

If,  as  an  alternative,  the  display  consists  of  an  integration 
of  real  world  visual  cues,  no  learning  process  or  interpretation 
should  be  required  and  the  information  present  in  the  display  would 
be  acquired  through  di f f erentation. 

Examination  of  the  performance  plots  of  each  evaluation  pilot 
very  definitely  established  four  significant  differences  between  the 
F-18  type  symbology  and  the  CFPD,  which  substantially  influenced  the 
obvious  differences  in  performance. 

1.  Essentially  no  learning  process  or  interpretation  was 
required  by  the  evaluation  pilots  when  flying  the  CFPD. 
Each  pilot  saw  the  CFPD  format  for  the  first  time  on 
the  evening  before  his  evaluation  flight  and  flew  the 
format  in  the  ground  simulator  for  only  one  half  hour 
prior  to  his  first  actual  flight. 

2.  The  second  important  difference  between  the  symbolic 
format  and  the  CFPD  relates  to  disorientation.  Several 
of  the  evaluation  pilots  indicated  experiencing  vertigo 
during  some  of  the  flight  maneuvers  v.'hile  flying  the 
symbology.  None  of  the  pilots  experienced  any  form  of 
disorientation  that  affected  his  operation  of  the 
aircraft  while  flying  the  Comm.and  Flight  Path  Display. 

3.  The  concept  of  utilizing  the  VSI  and  the  HSI  with  the 

CFPD  format  provides  an  excellent  indication  of  the 
wind  effect  relative  to  take-off  and  climb,  cruise,  and 
approach  and  landing.  The  immediate  indication  of  a 
change  in  wind  direction  becomes  evident  when 

corrections  in  heading  are  required  to  stay  on  the 
centerline  of  the  flight  path  on  the  VSI. 

In  addition  to  the  above,  turbulence  effects  were  no 
different  visually  in  the  CFPD  than  they  would  be  when 
flying  VFR. 
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1  INTRODUCTION 
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The  :ispsri‘v  oetMen  equioient  and  huian 
cerfc'nance  caoabilities. 

Technical  advances  in  micro— el ectroni c  technology  have 
enabled  the  performance  of  electronic  components  to  be 
dramatically  increased,  while  at  the  same  time  increasing 
their  performance.  The  same  is  true  for  servo-mechanisms, 
■r^etisors,  and  other  electromechanical  devices.  Unfortunately, 
the  compleKity  of  machine  operation  and  maintenance  has 
Increased  just  as  dr amat i cal  1  y.  This  trend  can  be  e>;pected  to 
continue  into  the  foreseeable  future  as  shown  in  Figure  1-1. 


> 

0 

O 

J 

o 

z 

z 

u 

UJ 


Ourinq  the  ini  till 
develoiitent  ot  neu 
•ichines,  huaens  have 
tyiiicelly  outperiorted 
thea. 


The  gap  in  cepabiiity 
between  huaens  end 
aichines  is  aideninq 
exponent  I  illy  and  huiins 
are  being  inundated 
■ith  inforaation. 

Kea  techniques  to  enable 
thea  to  interact  aith 
coaputer-driiren  display 
systeis  aust  be  developed 


TIME 


r :  g  .1-  '  ’-■.ipari  IncLit  Vvr '>us  Cooiputer  Processing  Capabiiicy 

The  ;.r  c  1  1  f  er  at  1  on  of  computer-ai  ded  systems  has  caused 
cec  i  Si  on— oia'-  :  og  tc>  i  icrease  rather  than  to  Decrease 
;ci.  IS  ciuntsr  to  rorniai  e>'peutat  i  ons .  Humans  have  been 
s':  j  :■  ’c  .h'-tiv'?  to  -vie  t  i  on  desoite  increased  WD>^lload  and 
Jec  -  si  on -'0  ai  1  rg  oecause  of  tleir  innate  capacity  *or  adapting 
dyr-.-ii'.'"  S' V '.lat  i  cnal  c^emarids.  H'-onans  are  psychologically 
a'd  pi-,  y  SI  ol  oq  1  c  a  •  I  >'  ve'- v'  •fie:;iLie  ;  »1  .adapting  to  a  wide  range 
y  e  ' .  r  _i;  • '1- nc  wj- I  :  rg  ccr-dition3  and  performance 
'  ecL.i  r  fciiiei  t  s.  '■havC'-  th  — 1  ess  ,  many  oper  ators  have  reached  a 
1  a  -  vi  1*  ■■‘■■ri-  '■■i.T.'.'  -  .'tu'-at  1  oti  becacse  of  the 

!.  t  '-evvr  ri...«ian- syst  ems  i  erf  aces . 


158 


R«produc«d  Irom 
b«t>  avaiUbI*  copy. 


As  system  capability  increases,  the  number  of  system 
-functions  and  mission  modes  also  tends  to  increase.  This  is 
evidenced  in  the  increasing  emphasis  being  placed  upon 
robotics  and  artificial  intelligence  to  reduce  the  burden  cn 
human  operators  and  to  Improve  system  performance,  as  well  as 
to  reduce  expensive  labor-intensive  production  and 
manufacturing  lines.  Rather  than  working  with  hard  materials 
and  components,  humans  are  working  with  information. 
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Figure  1-2  Mental  Workload  Saturation 

The  premise  that  human  interaction  is  not  necessary  nor 
even  desireable  is  a  faulty  one  since  even  so-called  fully 
automatic  systems  require  some  level  of  human  interaction,  if 
not  on  a  continuous  basis,  at  least  on  a  monitoring  and 
override  basis.  Maintenance  and  repair  also  requires  human 
intervention  and  interaction.  This  is  also  true  for  computer 
systems  employing  artificial  intelligence  as  a  means  of 
emulating  the  human  thought  process.  Human  interaction  is 
required  in  some  form  and  at  some  level— of -effort  for 
computer  input  preparation  and  insertion,  system  monitoring, 
and  output  application.  Machines  are  tools  to  provide 
artificial  extensions  of  human  physical  and  mental  functions. 
Humans  are  not  tools  of  machines.  At  least,  they  shouldn't 
be. 


Research  and  development  tasks  are  being  performed  by 
human-systems  and  display  engineering  specialists  at  the 
Westinghouse  Defense  and  Electronics  Center,  Baltimore,  and 
the  Research  and  Development  Laboratories,  Pittsburgh,  to 
conceive  and  develop  innovative,  more  efficient  display  and 
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control  techniques  related  to  multisensor  integration, 
arti-ficial  intelligence,  and  computer-aided  crew  stations. 

The  objective  is  to  reduce  the  amount  ot  usage  required  of 
keyboards,  handcontrol 1 er  devices,  and  discrete  switches  to 
control  the  movement  of  CRT  cursors  for  purposes  of  target 
and  data  designation  and  for  the  control  of  the  look-angle  of 
electro-optical  sensor  systems.  In  addition,  advanced 
sensor /di spl ay  systems  techniques  to  emulate  and  interact 
with  human  psycho-physiological  systems  are  being  researched 
and  developed. 
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S'...  -  cea'=r  o.i  4.  V  iierro'in  citis  inif=ior.  to  or  ov  i 'Oe  .c  i  ose-ai  r 
'rj.ppot  t  ar  I.'  oatr  ;  e- i  ei  d  t  nt  er  o  i  o  L  i  on  vNith  an  acceptable 
j.-obajil  1  '  ■  >.j-f  anccees  ai  c  eorvival  le  highi  /  quest  i  onab  1  e . 
Ti'e  e  rir>e  > -i  ti-ac  tc  perpetrate  acrc.as  tfio  Fi.GT  into  hostile 
i  or'r  4t'b''>'  --ov'  ueei.  str  1  r.e  -rd  *  n  •  er  c  i  c  1 1  c  n  rriissiorvs.  I-?  L‘,',e 

pi  !  ijt  ■ y  ^4^  ,3-'  i;nir.  wor  1  d  iE  aece,  i-Jeiit  Lccn  arti+icial  sensor 
ano  •.ii'-pnay  ;  iitnr  i  on  .  ne  ?s  sevs’^ei  v  c  oris  t  r  a  i  ned  as  to 
■  a|:>..‘t  c  re  •.  +  >  e  i  d -of  -  v  ^  ew )  .  Therefoj  a  if  vias  desire-able 

-O  Jel  e' ...  1 ;  p  o  1  ho  e-rects  of  st^rn  C'C  .•  fl .  so  i  a  y  aper‘tur“e  sice  upon 
t  i  i  j  i  lot  '  ;  a'_- -■  .  .'.tv  to  -?  1  y  -a  TK'l  A  pr  of  lie  ibelow  oOO  feet) 

a*  rj_*e»sr;js  t.  O'  i  ';>  *  ap'i  t  wi  t.np  c  '  * oiose  "air  "S -a  Q  p  c*'"' t  and 
L  a.  t  1 1  t-r  i  s  i  c  . I  ei'c  i  _i,  i  o''  .t.  i  ss  i  is  .ti>h  tnots'.  Since  the 

mato'-  'Cbs  r  a  to  p’^c.ndinc  sticri  -a  capatiiiity  is  the 
t  :  ;-p..a;' .  i;y  bo'weo:-  flaict'"o  opLicai  se-io-or  s  and  the  hr.iman. 

'.=>  al  system  ;  .e.  ,  between  * i el d-of -vi ew  and  resolution,  a 
■-1  o”  iss  o'f  f  1  i  ^t. t  tests  was  co.n-ducted  to  evalL-ate  the  effects 
of  ■.■lewcP'O  the  real-worlti  through  ii  i  f  f  er  ent  size 
-  1  s  i  d s-  of  -  V .  aw  V 

‘larv  c  C'( '.c  *  u.£  1  ons  were  reached  during  these  tests  among 
<.■:!  ich  ware  f's  f  c;-l  1  oi-a  f  sg .  It  was  very  apparent  that  the 
y.'oilitv  of  the  Pilot  to  iTiove  t'ls  t'ead  and  eyes  on  a  "swivel 
nerr"  is  essential  fo-  fi.irg  low  altiti'de  TF/TA  profiles 
tlsp'i.gh  iTiC'uru.  .ji  ;-,o  ..-.s .  billy  terra.ir  such  je  that  in  Central 
F  erir  sy  1  ssT' 1  a  .  Terr  air.  ir  Central  Europe  such  as  in  the 
p.'Obifiiity  of  the  Fuld-a  Cap  is  quite  similar.  To  fly  TF/'‘A 
cur'ing  night  and  adverse  weather  conditions,  i  c  was  concluded 
!.  had  an  el  ectt  o-opt  i  cal  image  must  have  the  following 
attr  ibutes;  be  itead  mounted,  provide  binocular  vision  if 
pC'Ssibia,  and  provide  a  visual  f  i  el  d-of -vi  svi  of  40-degrees 
lateral  by  30-ufrgrees  vertical.  Per.pheral  vision  and  visual 
a-cuity  were  highly  significant  in  providing  TF/TA  flight  cues 
to  the  Diiot.  Although  the  area  of  human  visual  perception  of 
afTib  1  quC'US  ,  p'arado:.  i  cal  ,  and  uncertain  snapes  was  not 
addr  essed ,  this  is  certainly  an  important  factor  -for 
low-altitude,  hign-speed  naviga.tioon  and  weapons  delivery.  It 
IS  certaini'y  an  area  of  r-esearcti  deserving  of  detailed  study. 
It  would  also  be  very  desireable  to  find  some  way  to  extract 
quantitative  measures  of  pilot  performance  as  a  function  of 
limited  f i el ds— of  — VI ew.  How  to  accomplish  this  remains 
undetermi ned . 

Table  2—1  provides  a  summmation  of  conditions,  the  visual 
f i el d-of -Vi ew  sizes  evaluated,  and  key  observations  resulting 
■^rom  these  flight  tests. 
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2-1  Summar ot  Sef^sor— Coi ip  1  ed  Vision  Flight  Test 


CONDITIONS 

16  June,  1951 
visual  Route  175"' 
Dahreliner  40 
2  Test  Pilots 

10  Passes  (5  each) 

1 1  ;  00  A . M . 

1  Vi  Mile  Visibility 
uOC'KTAS 


FIELD-OF-VIEWS 

Bi noc  ui ar ; 

48). 36-dears-e  Agile 
40X30-degree  Agile 
30  X'  1  B“tiear  ee  F i  v;  ed  , 

Snap-Look , Agi 1 e 
20X15-d&gree  Fi:;ed, 

Snap-Look , Agi 1 e 
Monocul ar ; 

40X30— degr ee  Agile 


CONCLUSIONS 


For  Low  Altitude 
Head  Agility 
FOV  >=40— degree 
30-dsgree 
2<0-degree 
Binocular 


Terrain  Avoidance 
Reaui r  ed 
Desired 
Possible 
Too  Restrictive 
Desired 


1.-  • 


The  Plight  tesc  was  conducted  as  simply  as  possible  to 
reduce  test  variaoies  to  a  minimum.  It  was  also  decided  to 
forgo  sophisticated  data  recording  and  analysis  techniques 
and  to  restrain  the  tests  towards  acquiring  empirical 
knowledge  rather  than  quantitative  analytical  results.  The 
test  procedures  were  structured  to  obtain  pilot  subjective 
opinion,  o-f  the  ability  to  fly  the  mission  profile  while 
viewing  the  real-world  scene  througJi  various  f  i  el  ds-of -vi  ew. 
The  different  f l el ds-of -v? ew  were  provided  by  modifying 
safety  eyeglases  to  provide  different  viewing  aperatures  as 
shown  in  figure  2-1.  Eyeglasses  were  chosen  since  the  pilots 
were  viewing  the  real-world  through  the  windscreen  and  it  was 
much  mor  e  accurate  to  control  the  geometry  of  the  aperature 
sizes  relative  to  the  facial  physiological  characteristics  of 
each  pilot.  The  intent  was  to  locate  the  visual  aperture  for 
each  eye  centered  to  the  pupil  of  each  eyeball.  This 
eliminated  the  possibility  of  inadvertently  extending  the 
visual  angle  for  each  eye  by  viewing  out  of  the  aperture  for 
the  other  eye. 
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Figure  2-1  Eyeglass  Apertures 

The  flight  conditions  were: 

1)  Aircraft;  Westinghouse  Sabreliner  40 

2)  Flight  Test  Personnel;  Pilots-  J.F.  Fendley  (Pilot  1), 
D.Z.  Skalla  (Pilot  2),  Human  Factors  Observer, 

T.A.  Stinnett. 

)  Date;  June  16,1981. 

)  Time  of  Day;  9;50-ll:10. 

)  Weather:  Clear  visibility  10  nmi ,  slight  haze, 
scattered  cumulus  at  5000  AGL. 

6)  Speed:  300  KTAS. 

7)  Route:  Visual  Route  VR  1757,  segment  C  40-degrees, 
41-minutes  north/77— degrees,  58-minutes  west  to  segment  D 
40— degrees,  47— minutes  north /78-degrees,  15-minutes  west. 

This  route  segment  is  located  in  Central  Pennsyvania  and 
runs  in  a  west/northwest  direction  starting  at  a  point 
approx; i matel y  9  statute  miles  southwest  of  State  College, 


Pennsylvania.  The  terrain  in  this  area  is  characterized  by 
low  mountains  and  rolling  hills.  Ridge  lines  tend  to  run 
orthogonal  to  the  Tlighit  path  making  it  possible  to  ex  plait 
the  terrain  -for  TF/TA  manuevers.  Mountain  elevations  above 
pass  elevations  are  typically  500-700  -feet  with  ridge  lines 
spaced  approximately  7000  -feet  peak— to— peak .  Pass  widths  are 
typically  1000  -feet  wide  with  the  narrowest  f.own  being 
approximately  220  -feet  wide.  Passes  through  ridge  lines  are 
not  coincident  making  it  necessary  to  per-form  up  to  2.5  to  3c 
maneuvers  at  speeds  of  300  KTAS.  The  terrain  -foliage  generic 
to  this  region  ranges  -from  complete  cover  by  deciduous  and 
pine  trees  to  open  pasture  ■faj'm  land.  The  -flight  path 
overflies  a  number  of  cultural  features  and  targets  of 
interest  including  paved  roads,  dirt  trails,  railroads, 
streams,  ponds,  farms,  higfi  tension  lines,  an  automobile 
junkyard  which  resembles  a  motor  pool,  and  coal  strip  mining 
areas.  Figure  2-2  shows  a  contour  map  of  this  region  with  a 
t ',/pi  cal  segment  of  Low-Level  Military  Training  Route  1557 
flown  for  this  flight  test  delineated  by  a  solid  black  line. 
The  numerals  1,2,3  spaced  along  the  flight  path  are 
correlation  points  plotted  between  the  aircraft  location 
with  specifi-^  image  film  frames. 


h  i  .^u.r  e  ^—.1 
Ru'au  VR  1 


Cor.to'-T  Mzip  Plot  of  SCVS  Flight  Test  -  Visual 
'T;'/ ,  Ceritra.i  F’ennsvl  vani  a 


Five  di-f-ferent  sizes  at  eveolass  -f  i  ei  d-of -vi  ew  aperatures 
were  chosen  tor  evaluation.  Two  of  the  sizes  were  current  and 
LhWTIRN  l)ead— up  display  (HLD>  f  i  ei  ds— ot -v  i  ew  ana  thie 
renaining  three  were  selected  because  they  reoresented  the 
state-of-ti'e-ar  t  o-r  EO  seri=ur  technology.  Table  2-2  speci-fies 
the  aperture  sizes. 


■  •  ds'-ot ew  Evaluated  in  idCVS  Flight  Test 


■'Cr'  i  z  on  c  a  J 


M  e  r  t  I  c  a  1 


ui  agona.. 


System 


F  i  el  >.1-ot-V:  t'w  F 1  el  d-o- -'.'i  ew  Fi  el  d-ot -Vi  sw 


TS-c'egrees  36— ceorees 


.{..j-rjegrees  SGVS  Future 
(3;<4  ratio)  (Aaiie) 


40-degrees  30— degrees  SO-degrees  3CV5  Eiaseline 

<3x4  .-.atio)  (Agile) 

30 -degrees  13-degrees  35-degrees  LANTIRN  Holographic 

(Fi  xed/Snap-Look 
Agile) 

2o-dsgrees  15-degrees  25— degrees  LANTIRN  Standard 

Optics  (Fixed/Snap- 
Look  ?'  Agile) 

40-degrees  30-deQrees  50— degrees  SCVS  Future 

(3;:4  ratio)  (Agile  Nonocuiar) 


The  middle  size  FOV  a-f  40-degrees  horizontal  by  30-degrees 
vertical  is  considerc'd  to  be  the  most  realistic  maximum 
aperature  size  that  can  be  achieved  with  current  EO 
technology.  Because  time,  money,  and  FAA  regulations 
precluded  any  attempt  to  emulate  a  HUD  + 1 el d-o-f -vi ew  by  more 
elaborate  aperture  ap'paratu.s,  it  was  not  possible  to  exactly 
reuresent  a  HUD  -f  i  el  d-of-view.  When  -flying  a  segment 
evaluating  one  of  the  two  HUD  f i el ds-of -vi ew ,  the  pilots 
attempted  as  best  they  could  to  fixate  their  heads  forward 
and  to  resist  moving  their  heads  to  extend  the  visual 
f ield-of-regard.  During  the  four  runs  to  evaluate  HUD 
f i ei ds-of -vi ew ,  they  also  exercised  full  agility  of  head 
movement  during  a  portion  of  the  run  as  they  did  with  the 
SCVS  f i el ds-of -vi ew  to  enable  a  comparison  to  be  made  of  the 
20-and  30-degree  f  i  el  ds-of -vi  ew  vji  th  the  40  and  4B-degree 
f i el ds-of -vi ew.  The  two  larger  eyeglass  apertures  of  40-and 
48-deQrees  were  considered  to  represent  a  helmet  mounted  SCVS 
disipla-/  and  the  pilots  were  unrestrained  in  their  head 
movemeiiLs  at  ail  times.  The  question  of  monocular  versus 
binocuiat  visiun  was  carefully  considered  prior  to 
constructing  the  eyeglass  apertures  and  it  was  decided  to 
provide  binocular  apertures  with  the  ability  to  block,  the 
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left  aperture  to  monocular  vision  only.  The  state— of —the— art 
of  helmet-mounted  display  technology  has  prohibited  the 
provision  of  binocular  vision  capability  and  this  limitation 
is  considered  to  be  somewhat  controversial  as  to  the  effects 
on  pilot  psycho-physiological  reaction. 

For  clarification,  it  is  necessary  to  understand  that  the 
SCV5  flight  test  was  conducted  viewing  the  real-world  scene 
with  binocular  vision.  However  for  an  actual  SCVS  system,  the 
pilot  would  be  viewing  an  electro-optical  display  image  with 
binocular  vision.  When  viewing  the  real-world,  each  eye  sees 
the  scene  from  a  slightly  different  angle  as  a  function  of 
range  to  the  point  focussed  upon.  When  viewing  an 
electro-optical  image,  each  eye  will  see  identical  scenes 
independent  of  range  to  a  point  of  focus  and  it  is  not  known 
if  this  is  significant.  It  is  obvious  that  to  provide 
binocular  vision  for  a  helmet-mounted  display,  the  complexity 
of  the  opti cal /di splay  mechanism  is  greatly  increased  as 
compared  to  that  required  for  a  monocular  system.  For 
e;;ampie,  a  binocular  system  requires  very  precise  adjustments 
to  ensure  that  each  exit  pupil  is  exactly  centered  over  each 
eye  to  ensure  that  only  a  single  image  is  per'ceived. 
Singleness  of  object  vision  is  dependent  upon  the  light  from 
a.  single  object  impinging  upon  the  retinas  of  both  eyes  at 
identical  points.  If  differences  of  impingement  exist,  double 
vision  will  occur  if  the  disparity  is  large  enough,  or  if  the 
dsparity  is  not  significant,  the  object  will  appear  as  a 
single  object  but  at  a  range  further  or  nearer  than  for  a 
f.'.ateQ  abject.  Whether  or  not  this  complexity  is  warranted 
is  unknown  at  this  time.  To  obtain  some  feel  for  pilot 
reaction,  several  passes  through  tkie  route  were  made  using 
fnonocuiar  vision  bv  blocking  out  the  left  aperture.  The 
tradeoff  between  binocular  and  monocular  vision  will  require 
much  niore  study  and  research  before  any  intelligent  decision 
can  be  reached.  Howe-ver  pilot  observations  were  that  the  use 
of  both  w=r,s  superior  to  monocular  vision. 

Both’  pilots  had  previously  f  1  ow'i  VR  1757  making  it 
.coecessars  to  i  v  any  f  smi  1  i  ar  i  c at  i on  passes,  ‘''he  oasic 
flight  procecure  was  for  one  pilot  to  fly  east  to  west  over 
tne  course  seg-nei ■  t.  wea"ing  one  of  the  eyeglasses  ar.n  the 
•ether  TO  fly  the  reverse  direction  wearing  the  same 
e->t'Cji  asses.  Ec'th  pilots  tested  ail  apertures  oi-ing  a  total 
of  te-^  runs  cNer  the  course.  The  seouence  of  test  for  the 
eyiaglass  apertures  is  shown  in  table  2-3. 


:  eu.Lii  -  j  teqi-i&r.cti  o-*  i  c 

Horisontal  ’^cet-t'.ire  Rir-nar  i;s 

.-ip-QegreE'  binocular  Pilot  allowed  tc  move  head 

'.'oei  V. 

-degree  bi  nocuiar  Pilot  allowed  to  move  neac 

i r  ee 1 v . 

7‘‘-0egroe  tiDocula*-  Pilot  instrLicted  not  to  rotate 

head  1  .iter  ail  v  i  +  pos  a  i  b  1  e 
e;  t-ept  -far  enap-look. 

Zt'-'jeqree  b  i  r.  ocul  ar  Pilot  instructed  not  to  rotate 

head  laterally  it  possible 
a-  cept.  -for  STiap- j  ool  . 

i^.t-Hecr  ee  monocL  ’  a-  P.Jot  ciilowcic  to  move  head 

t  r  ee 1 y . 

rhj  :.  seqi  once  was  '..huseri  to  provide  as  much  terra;.n 
+  a.i'- i  1 1  ar  ;  o  an  1  on  a-s-  oossible  to  the  pilots  working  -froni  tlie 
:  t  .1  the  f'arrcjvter  apertures  since  it  was  reasonable  to 
a.-.^ucc  ti  at  tt  e  r.  arr  ower  aper  cut  us  i^ouiP  be  progressi  el  v 
■T'ors'  c'ltficult  to  Ply  with.  The  test  pilots  were  a5i:eo  to 
restrict  she  movement  o-f  their  heads  as  little  as  possible 
t^’or'.  a  pcr.ii.Lon  loovi/ig  dead-ahead  when  wearing  the  3t<  and  20 
d.agree  aps'-ture  eyeglasses.  The  purpose  o-f  this  restriction 
tyas  tv’  rep’ic-ce  as  closely  as  cossitle  the  viewing  o-f  ar^ 
el  eci  ro-op  L  i  c-ai  image*  through  a  nead-up  ci  splay  -fixed  to  the 
glare  shiel-c.  They  were  permitted  co  rotate  their  heads  just 
tr:-or  to  executing  a  turn  to  achieve  a  "snap-look''  e-frect. 

-o,-  all  at^;er  aperture  siiies,  the  test  pilots  were  asked  to 
move  their  heads  as  naturally  as  they  desired  to  replicate  a 
hel  mei. -moutited  display.  The  ^O-degree  aperture  size  was  -flown 
•a  second  time  with  the  le-ft  eye  aperture  occluded  to  pro-yide 
monocular  vision  only.  This  was  done  to  enable  a  subjective 
opinion  to  be  expressed  by  the  pilots  the  relative  merits 
o-f  binocular  -.ersus  monocular  viewing.  The  pilots  vsere  asked 
to  -fly  a  TF/TA  pro-file  as  lo»-^  as  possible  commensurate  with 
tfie  FAA  requl.stions  t3averning  visual  route  VR  1757. 

Data  recording  was  limited  to  the  voice  recording  o-f 
si-b;ect.ve  opinion-^  an.1  comments  made  by  the  pilots  during 
and  atter  each  pass.  Ti -e  purpose  was  to  capture  their 
spontaneous  impressions.  A  debriefing  session  was  also 
i- orid  icteci  a-ft'?*"  returr  irq  to  the  West  ingh-^-use  Defense  and 
Elt'ctronics  Center  Flight  Test  Facility'.  A  second  debriefing 
was  conducted  with  Westinghouse  management  and  engineering 
personnel  -at  a  later  date. 

Photogr  aptii  c  recording  during  the  flight  test  was  made  by 
the  human  factors  -flight  engineer  using  a  Canon  AEl  35mtn 
camera  1  oad-ed  with  kodak  Kodacolor  400  film.  Movie  camera 
film  recording  of  similar-  flights  through  the  route  were  made 
on  September  17,1981,  after  it  was  decided  to  continue  to 
pursue  researcf)  a.nd  de'vei  opmient  related  to  sensor-coupled 


vision  systems.  For  these  scene  recording  -flights,  a  16mm 
movie  camera  providing  an  85— degree  -f i eld— o-f— view  was 
hard-mounted  into  the  nose  of  the  Westinghouse  Sabreliner  to 
provide  the  widest  possible  f iel d-of-view.  This  camera 
installation  required  the  removal  of  the  weather  radar 
antenna,  the  design  and  construction  of  a  camera  hard-mount 
structure,  and  modification  of  a  radome  to  provide  a  window 
for  the  camera  lens.  In  addition  a  35  mm  movie  camera  was 
mounted  above  the  pilot's  seat  at  a  position  approximating 
the  eye  location  by  suspending  it  from  the  ceiling  of  the 
cockpit  by  "bungee  cords".  The  camera  was  hand-held  so  that 
it  could  be  retained  at  a  HUD  positon  or  rotated  freely  to 
follow  the  pilot's  visual  gaze-angle  to  emulate  a 
helmet-mounted  display. 


^4  ar-- 
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Figure  2—3  Sabreliner  Camera  Installation. 


A  total  o-f  six  passes  Mas  made  through  the  route  and  both 
fixed  and  free-rotating  camera  movements  were  conducted.  Th 
recorded  film  was  processed  and  has  been  used  to  provide 
imagery  for  subsequent  human  factors  research  related  to 
sensor— coupl ed  vision  systems.  Figure  2—4  shows  examples  of 
3Snim  film  recorded  scenes. 


Figure  2-4  Ei-amples  of  35mm  Film  recorded  scenes. 


The  hutman  -factors  -flight  engineer  also  made  a  voice 
recording  calling  out  radar  altitude  and  the  initiation  and 
termination  of  each  maneuver  during  the  flights.  The  purpose 
was  to  obtain  a  timeline  and  profile  for  plotting  on  a 
1:24000  scale  U.S.  Geological  Survev  map.  This  also  enabled 
photographed  areas  to  be  correlated  with  the  map. 

The  results  of  this  flight  test  were  subjective  with  no 
quantitative  data  recorded,  therefore  caution  is  advised  in 
attempting  to  extract  specific  conclusions  from  pilot 
observations  and  opinions.  Key  observations  are  summarised  as 
foil Qws: 

*  Peripheral  s-ision  is  very  critical  to  the  pilot  as  a  means 
uf  discerning  range,  altitude,  speed,  and  anticipation  of  the 
terrain  characteristics  in  front  of  the  aircraft  into  which 
he  wants  to  marieuver. 

*  Both  pilots  expressed  astonishment  at  how  much  they  relied 
upon  peripheral  vision  under  normal  visual  conditions  to 
pro-.'ide  depth  perception  cues.  They  were  nott  aware  of  this 
dependency  until  their  peripheral  f i el d-of — vi ew  was  reduced. 

*  Mor.ocular  view.ng  as  compared  to  binocular  ''lewing  was  much 
more  difficult.  Depth  perception  was  completely  lost  making 
It  diffit'.ult  to  e-stjmate  the  distance  to  the  next  ridge-line 
and  altitude  was  very  cfifficult  tc  estimate.  Monocular 
viewing  caused  boi  h  pilots  to  underestimate  their  altitude  by 
ha;v.  Both  c.loti-  exitited  a  reluctance  to  push  over  after 
cr.jssing  a  r‘iuge-line  because  of  the  alt'tude  perception 
problem.  It  was  also  more  difficult  for  the  pilots. to  orient 

^  .ne) »  pH'V.ition  relative  to  the  terrain,  as  for  e'amp’e  when 
maf-eu ve*  i  nc  Lo  enter  a  vailey. 

-*■  Vhe  na.  r  ower  the  -r' i  g-of  ~v  i  ew  ,  the  more  tli-'  +  icul-t  it 
became  to  1  y  ttie  aircraft  in  a  terrain  avoidance  orofiie. 
Oei-.'tl  pet  cepv  1  or-  degraded  as  r.he  +' i  e  J  d- D-i  — s- 1  ew  became 
sma I i er . 

r  "r.e  ab i  i  I'  v  to  tiiove  ti-.e  iiead  to  obtain,  a  vside 
f  i  e;  d-of -r-=ga*^a  is  necessary  to  f  . -v  iierrain  a.voi  dance  on 
'.'ist.ai  Route  t'R  ll’-Z'?  i..r>der  VFR:  conditions. 

T:  e  .1  vx  r  acosi  1 1  on  of  ndge-iines  pro-nded  valuable  clues  for 
e -t  1  ftiat no  distarue  ar>c  altitude,  winen  tvJij  n>>  more- 
r  uge-i  1  ng-s  were  -visible,  che  perceived  motio''.  of  r^earer- 

ici-ue--  ine  re.a'tive  co  tiie  -^urtt  or  ridge-lir't?  vMas  v  sea  lo 

t;-‘rra:r’  c,  '  earance  over  the  rr-n.-er  ridce.  When  oril'-' 
one  riuge-liOa  co.lii  be  seen  i.gaiu-st  uhe  sty,  both  pilots 
.  -i.VtS  .  i  a  i.e '  ■ror.o-.:  at  ed  by  rcmr.ar-ji.n  a  "spot"  on.  tt'O- 

w  ;  I -n  cur  u'oo  i.'.up  t;ie  ridge-l:rre. 
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DL'-t  or  eyes  dov>)n  into  the 


+■  Terrai'i  tollowinq  was  relatively  easier  to  -fly  as  compared 
i  f  j  terrain  avoioance  o.er  ViSL.al  Btiute  1757.  All  five 
e/aluated  vi  iicil  +  i  el  dn -of -vi  ev'j  col, Id  he  f  1  ov'fn  in  a  fi;.ed  flUD 
Or  head-aqile  mode  for  terrain  fallo^^llng. 

♦-  a  i  :■  1  nq  .  1  .  e  .  ,  e-peritnce  qained  a'^^ter  each  pass,  proven 

Lo  be  bene-rcial  for  position  orientation  to  enable  the  ne”t 
manet' V er  t o  t e  ant  i  c  i  p ated . 

*  Tt'.o  percei.'tn,=,l  sc*t  of  generic;  geographic  and  cultural  cues 
s,;.<ct  as  tree  sirres,  road  widths,  ridge  contours,  vehicle 
si.:es,  IS  -.'e.-'y  imptiriant  in  prcviding  distance  cues. 

*  Sirce  ttiiS  fl)ght  test  was  condtiLted  with  true  binocular 
visicfi  o-  tlH?  "r  eai -wor  i  o  ” ,  the  effects  of  viewing  a  single 
svntnetir  e’ ectr  (1- opt  1  cai  scene  with  both  eyes  while  flying 
tt'rra.in  a.oicjurne  is  urtrown.  This  situation  must  be 
evaluateo  by  some  type  of  experi  mental  labo'^atory  apparatus. 

*  The  deqredation  exuer  i  ericed  in  viewing  ability  through 

di  f •‘^erent  si  'eci  arerr.jres  was  most  dramatic  when  transferring 
from  the  3f'  to  t!ie  oO-degree  f  i  el  d-of -v  i  ew. 

*■  Both;  pilots  judged  that  if  they  absolutely  had  to,  they 
might  bcrf  aL.lo  to  fly  a  30-uegree  f  i  el  d-of -vi  ew  sensor -coup  1  ed 
'■•is;  on  d.  op  lav  provided  tiiat  they  could  freely  swivel  their 
heads  and  th.at  the  sensor  resolution  was  adequate. 

*  There  was  a  tendency  to  fly  lower  than  intended  with 
bir.cicuiar  vision  as  the  visual  f  i  ei  a-of -v  i  ew  was  reduced. 

This  was  the  opposite  effect  experienced  when  flying  with 
iTionc'Cular  vision  which  created  a  tendency  to  estimate 
altitude  lower  tliat  it  really  was. 

*  Both  pilots  overestimated  altitude  as  the  f i el ds-of -vi ew 
were  decreased  in  size. 

*  With  narrower  f  i  el  ds-of -vi  eis  replicating  a  fixed  HUD,  both 
pilots  tended  to  unconsciously  rotate  their  heao  vertically 
upward  to  see  into  the  turn  and  to  gather  more  depth 
perception  cues.  When  they  realized  that  they  were  doing  this 
and  concentrated  on  not  rotating  their  head,  they  tended  to 
scan  their  eyes  up  and  down  in  the  vertic.al  plane  in  an 
attempt  to  achies'e  the  same  effect. 

*  Extreme  difficulty  was  experienced  with  f i el ds-of -vi ew 
sfitaller  than  40-degree5  in  finding  and  following  narrow 
valle\'S.  Several  turns  were  missed  because  the  pilot's 

f i el d-of  -VI ew  was  too  small  to  enable  him  to  visually  discern 
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valley  entrances  and  to  anticipate  turns. 

*  The  vertical  -f ield-o-f-view  was  considered  to  be  as  critical 
as  the  horizontal.  This  was  especially  true  for  the  narrower 
f i el ds-of -vi ew. 

*  There  was  a  tendency  to  unconsciously  descend  in  a  turn 
when  flying  with  fi el ds-of -vi ew  smaller  than  40-degrees. 

*  With  visual  f  i  el  ds-of -vi  ew  narrower  than  40-flegrees,  the 
p'lots  tended  to  fly  close  along  either  wall  of  a  valley 
using  the  side  of  the  valley  to  {-'ovide  peripheral  cues.  This 
obviously  made  it  more  difficult  to  anticipate  turns  into  the 
opposite  side  of  the  valley.  This  tendency  is  much  like  a 
person  groping  his  way  along  the  wa* I  of  a  dark  corridor. 

*  C’ oud  shadows  on  the  ground  can  be  misleading  when  vision 
IS  restricted  by  narrow  f lelds-of -view.  When  flying  with  the 
20” degree  f i el d-of -vi ew ,  one  of  the  pilots  thought  that  a 

cl ouG  shadow  on  a  hillside  was  the  entrance  into  the  valley 
through  which  he  wanted  to  go.  This  was  so  misleading  that  he 
had  to  be  alerted  by  the  other  pilot  who  was  acting  as  safety 
pilot,  that  he  was  about  to  fly  into  the  mountain.  By  the 
time  he  visually  acquired  the  entrance  into  the  real  valley, 
he  misled  it  and  had  to  pull  up  and  overfly  the  ridge. 

*  Whc»f'  traciing-eff  resolution  versus  distance  cues  provided 

t'y  i.e.,  distant  h.lls  are  more  hazy  than  closer  ones, 

t  ;e  pilots  would  rather  have  sensors  capable  of  providing 

^  ■ yh  resolution  of  distant  ridges  attenuated  by  haze. 

*  .'s  the  vis’-al  f  i  el  J -of -vi  ew  is  ^  educed  ,  there  was  a 

'  y  *  o  sta't  a  H-rn  loo  late  which  resulted  in  the 

.e.jitv  to  pop-up  over  a  ridge  instead  of  being  able  to 
ay  witl''r-  the  val!ey. 

•row  T  i  el  do- -VI  ew  ,  esp>ecia'ly  20-degrees,  created  a 
'ercy  to  e;<ecute  overly  abrupt  climb  maneuvers.  This  was 
entlv  due  to  Che  inability  of  the  pilot  to  accuratelv 
distance  to  ridge-lines. 

*  A  d  i  sc 'iricer  1 1  og  toss  of  a- rcra-tt  attitc.de  re-'erence  was 

e:. per  ;  encud  when  put  ling  up  over  a  steep  ridge-,1  ;ne  at  a  high 
l!  hnb  -»rgle  so  toat  all  t'.^t  -^ouid  be  seen  forward  through 
tie  vuocscreeii  was  sry.  I'l'iiS  ol  inost  borhe’^ed  on  ver'tigo. 

<  I”  tha  se.'is-ir  girrn.i  «l  is  Vo  be  slaved  tc‘  an  eve-t*- acl  er ,  as 
•^cr  t  r  cfMcap'.  .  tenser  lag  r  eso  i  u  c  i  oi'  scece  lv-*c 

r'lVi  ;P  the  Hide  f  .  e '  d-o-r -v .  ev>«  di'r>plav)  is  ev^ectea  to  be  a 
:  ;  t  .  ■  p.'  uh' um.  Tins  cibser  .'at  i  ij:  refe-'s  to  the  Br  i 'jht -Eve 

pt  i  i,  :i  v.'.sst-J  .  n  the  ne:':t  section  o-f  this  pacer. 

Vi  s  j-  e  ;  ’  ots  e  c?  t-ssed  corn.c-  r-  fl  at  vertigo  might  be 


ij 

I 
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induced  by  such  a  lag. 

*  Flying  with  a  wingman  or  a  larger  strike  element  can  be 

expected  to  create  severe  problems  in  coordinating  tactics  ~ 

and  avoiding  mid-air  collisions.  Situational  awareness  is  It 

expected  to  be  a  real  problem. 


3.  SENSUR-COuFLEI)  VISION  SVSTEr.S 

The  results  f  r  h  e  SCVS  -fiight  tests  indicated  the  need  tor 
a  sensor -Cl  SDl  av  comD  i  na  1 1  or-  that  provided  the  cest 
dossibie  t .eld-at-view  and  hign  resolution.  Slice  sensor 
resolution,  ueuradss  as  -  ;  el  c-o-f  -  vi  ew  iniir  eases,  the  or  3  y  .^av 
t.,  arieve  this  capacii;  ty  is  to  integrate  a  wide  ano  narrow 
-  1  el  d-ot-v;  ei'i  cctical  t'-ain  to  provide  a  coiriposite  scene 
Ml'?  :e.  Ti-fj  3ir;gh<-  -E/e  concept  was  conceived  by  the 
iiuut .  ng hi.-,. c  y.  Dcfe'-se  ar'-i  Ele^t-oriia  Center  as  a  solution. 

Til  a  id'  es ;  og  th'^  3-  igT.tEye  concept,  it  is  tirst  necessary 
1 -•  1!  iter  St  a' lu  ti's  chat  ucteristics  o-t  the  human  eye.  Tt;e 
r etiia  ot  the  eye  is  sensitive  tc  radiant  energy  within  tne 

isiblt  ccectrcri,  w^ich  tuvinc  been  re.'racted  ty  the  lens, 

•forms  rf  ir-vfer  tsc  i'T.-ice  falling  upon  the  retina. 

1.  ight  seusit..-e  neu'  al  re._epLor  s  ir  the  -etina  called  rods 

d  rule. 5  --cn-er  t  th»  .r-ver  ted  i  ma-je  into  nerve  impulses 

w-ich  are  carrit.j  b ./  the  opt.o  ■-•er  vo  to  tt  e  brain.  The 

.uty  flie  '  etifu.  tt-  ).y;bt  1  ■^.  depi?noent  upon  the 
-•iiO'.-it  •.*  i  . -ghl  -•all'i'^g  opt"-  tie  r  ijds  and  cones.  The  i-ovea. 
wl  ic’’;  is  «  s-taii  S' ea  of  She  r  ecina  providing  high  t  esolutior 
c  -Lt  Ps  ofl,'  cort-s  whif.t'  are  sensitive  t-o  red,  green,  arid 
Lite  lichi  ana  :nu'*ease  i  r>  jjei'si  t :  i  ty  about  eirty  tines  as  a 
c’  o*  o-f  'Jet  reasi  ny  liyf't  level.  The  rods,  whicn  are  most 
-ivrsitivfe'  to  C'eer.,  increase  ir  sertsitivity  more  than  25,000 
i.  hs  a  -fingtictM  o^f  decreasing  light  level.  In  dim  I’.ght, 

Vi'iioii  is  primat  ily  gererateo  by  the  rods  which  are  color 
bl.id  hut  are  especially  sensitive  to  detecting  movement 
vjthj-,  •#  ;  el  d-cf ’V*  ew  O'f  the  eye. 

Ihe  visual  acuity  o^f  the  human  eye  is  very  high  within  the 
f'.vea  -area  of  the  retina  within  a  f  i  el  d-of -view  of  1.5  to  2- 
T.sgrees,  tut  drops  off  raoidly  a.;  a  furrction  of  the  angle 
o‘f-a:sis  from  the  fovea  so  that  at  around  20-degrees,  visual 
acuity  IS  -very  low  as  shc'wn  in  figur'e  3-1. 


Degrees  Off  Axis 


Ficure  3-1  Visual  Acuity  of  the  Human  Eye 
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However,  the  eye-brain  combination  compensates  -for  this 
loss  in  acuity  by  continuously  rapidly  scanning  the  eye  about 
the  scene.  Rather  than  constant  or  uniform  scanning  motions, 
the  eye  normally  fixates  at  points  for  about  0.3  seconds  and 
then  moves  extremely  rapidly  to  a  new  fixation  point.  This 
resolution  characteristic  of  the  eye  is  demonstratable  by  a 
very  simple  procedure.  While  looking  at  and  fixating  on  a 
single  character  on  this  printed  page,  it  is  impossible  to 
resolve  and  read  another  character  four  or  five  spaces  away. 
Peripheral  visiori  also  provides  extremely  critical  cues  that 
provide  orientation  of  the  spatial  relationship  of  the 
physical  world  as  visually  perceived  by  the  human.  For 
example,  it  is  very  difficult  if  not  impossible  to  maintain  a 
sense  of  balance  or  to  move  about  without  peripheral  vision. 
However,  humans  can  move  about  very  easily  with  the  foveal 
vision  occluded  using  peripheral  vision  only.  The  series  of 
Westinghouse  flight  tests  conducted  during  1981,  determined 
that  a  visual  f leld-of -view  of  40-degr ees  with  full  head 
movement  was  the  absolute  minimum  required  to  fly  the 
aircraft.  This  miriimum  was  considered  to  be  hazardous  and  did 
r-ot  include  target  search  and  acquisition  as  a  part  of  the 
test . 

The  acui tv  of  electro-optical  sensors  such  as  television 
or  infrared  is  a  function  of  f i eid-of — vi ew.  To  achieve  a  wide 
sensor  f i el d-of ~vi ew  that  emulates  the  peripheral  vision  of 
the  human  eye,  resolution  must  be  sacrificec’  Conversely,  if 
a  higtt  resolution  that  is  compatible  with  the  foveal  vision 
of  the  eye  is  prav.ded,  then  the  wide  sensor  f i el d-of -vi ew 
must  te  reduced.  Contemporary  el ectro-opt i cal  imaging  sensors 
reiy  upo'.  ar  optical  zooming  technique  to  achieve  both  a  high 
i  nci  low  resolution  image.  However,  a  penalty  is  paid  since 
the  high  and  low  resolution  images  can  only  be  sequentially 
ciapla/ed  causing  the  observer  to  lose  a  sense  of  orientation 
within  the  scene  area  surrounding  a  high  resolution  image. 
Therefo'-e  it  mattes  sense  to  conceive  an  electro-optical 
censor  system  providing  two  integrated  f i el ds-of -vi ew  as 
'-i>'!Owp  figure  3-2. 

The  high  resolutior*  f  i  el  d-of -v  i  ew  may  be  centered  within 
and  coupied  to  the  low  resolution  f i el d-of - vi ew  so  tnat  they 
move  l-c'ethe'"  with  the  gaze-angle  of  the  eye  or  the  wide 
f i el c-cf-vi ew  may  be  f i :  ed  or  controlled  by  some  other  means 
and  the  narrow  f i el d-of - v i ew  is  decoupled  and  is  free  to  move 
aroi. od  withi.-  t^le  wide  f  i  el  d-of  -  v  i  ew  as  controlled  by  eye 
mo-ement.  Th-.s  <.  umb  i  nat  i  on  provides  the  effect  of  perceiving 
?  higrt  ••esulution  a  mage  throughout  the  wide  f  i  el  d-of  —  vi  ew 
iih.ie  >eta,ni'ic  r  pen.jheral  -^ieid  with  a  resolution 
'.O'  s;  iteri*-  wi‘!i  the  peripheral  ret;n;\l  acuity  of  the  eye.  A 
\  S'  >  c  or  c  :  cer"  at  1  e  uai.e  C'f  tr.owledge,  hardware,  ana  experience 
rr  sts  with  ifcsptct  to  the  design  and  application  of 
!  1  •  hnat  -  "lOi-ii  o' VO  •_«  I  so  1  ays  in  airborne  systems.  However,  this 


'■owl-aoge  base  has  not  yet  been  e;< tended  to  encompass  the 
jverall  sy5t«?(Ti  coricept  o-f  Bright— Eye  tc  ground— based  systems, 
r' .ert'-f  ote  .  f'le  purpiose  at  this  research  activity  is  to 
.■=*li<j3te  this  system  ccinceet  wi+fi  strong  emphasis  being 
-laced  on  tht-  coi'.s.  Jer  ati  cn  o-f  the  human-svstems  design 
:  spe(.  t  s . 
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r-.uure  7-2  Composi  ce  Sensor  Fields-o-f  View 


Laboratorv  simulations  and  experiments  are  being  planned  to 
eva’uate  human  per-formance  and  acceptance  o-f  the  system  since 
these  sre  o-f  fundamental  importance.  Every  e-f-fort  in  the 
lir  oposed  program  must  be  measured  in  terms  o-f  its 
contribution  toward  achieving  this  acceptance.  A  feasibility 
demcnstr -t i on  consisting  of  a  laboratory  and  hardware 
breadboard  was  itiitiated  by  Westinghouse  during  1981. 

Althuigh  t  Lid !  men  tar  y  in  form  and  capability,  the 
demonstr at  ion  breadboard  was  sufficient  to  enable  many 
!'i. man-systems  aspects  to  be  subjectively  evaluated.  The 
demonstrat ion  breadboard  consisted  of  a  5— degree 
1  el  ci--’?f- V  i  ew  ,  high  resolution  TV  camera  developed  by 
westinghouse  for  the  IJSAF  Fave  Spike  weapon  delivery  pod 
wtiich  was  coupled  to  a  commercial  40-degree  f ield-of  — view  TV 
camera.  A  common  ser vo-gi mbal 1 ed  mirror  provided  a  common 
boresigbt  for  both  cameras.  A  5— degree  window  in  the 
40-degr  ee  -f  i el d-of -vi ew  camera  was  blanked  out  and  the  high 
re-solution  video  was  inserted  in  its  place.  The  combined 
video  was  the.n  displayed  via  a  l-inch  CRT  developed  by  the 
Westi ryhouse  Tube  Division  at  Elmira,  N.Y..  An  aculometer  was 
designed  and  developed  to  provide  the  eye— tracker  function. 
The  oculometer  incorporated  a  near -i nf rared  LED  coupled  with 
a  quadrant  tracker  to  illuminate  the  rear  of  the  pupil  by 
re-flected  light  from  the  retina.  While  the  1— inch  CRT  used 
for  tf»e  demonstrat  1  on  did  f>ot  provide  the  narrow 
f  leld-c-f-view  resolution  required  for  an  operational  system 
(405  TV-lines  versus  a  minimum  of  1000  TV-lines  required),  it 


was  considered  adequate  to  demonstrate  the  concept. 

A  functional  block  diagram  o-f  the  laboratory  apparatus  is 
shown  in  figure  3—3. 


Figure  3-3  Functional  Block  Diagram  of  the  Bright— Eye  Concept 

Figure  3-4  shows  the  laboratory  apparatus  demonstration 
hardware. 
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Figure  3-4  Bright-Eye  Laboratory  Demonstration  Hardware 


In  addition  to  demonstrating  the  -feasibility  o-f  the 
concept,  the  laboratory  breadboard  provided  a  means  to 
determine  the  requirements  -for  certain  critical  experiments 
prior  to  de-fining  the  criteria  -for  an  optimum  system.  In 
particular,  high  agility,  servoed  control  o-f  the  narrow 
■f  i  eld— o-f  — vi  ew  is  required  to  close  the  loops  for  control  of 
the  narrow  f ields-of — view  by  the  eye  tracker.  A  detailed  and 
comprehensive  task  outline  has  been  prepared  to  guide  the 
experimental  evaluation  of  system  uncertai ni es ,  including:  1) 
coupling  of  the  Bright-Eye  display  to  eye  movement  via  an 
oculometer  and  eye— tracker,  2>  the  parameters  of  eye  movement 
c.nder  tlie  various  influences  present  in  the  environment  for 
Br  ight-Eye  application,  3)  consideration  and  evaluation  of 
the  variables  ir,-/Dlved  in  d-iai  visual  f  i  el  d— of  — vi  ew 
1 n t eg r at i oi ' ,  4)  mul ti -di mensionai  display  and  real-world 
scir>rie  r  eg  1 -itr  at  i  or- ,  and  5)  investigation  of  possible  system 
'  Oi  !f  ,  yur  c<  L  1  QRS  applicable  to  more  advanced  versions  of 
B'  l^ht-Eye  such  as  stereoscopic  presentation  and  display 
rr.agni  f  i  cat  1  or  .  The  detai  led  treatment  of  these  topics  has 
progressed  according  to  priorities  based  on  their 
Si  gri -f  1  car-^ce  tu  the  developmental  process,  first,  to  bridge 
.  r<f  or  ifi?t  i  or^al  lacuna  fiat  might  impede  development  and, 
secoi  uiy,  to  treat  tt'.ose  issues  whose  resolution  serves  to 
cr>t<>rce  'he  dev-el opmental  process.  AmDt->g  the  issues  of 

1  ntar  /  i.oc’cerr'  to  the  successfoi  development  of  an  effective 
Br  ;  gM -E-ye  systein  are  those  conce*  ned  with  the  inevitable 
Lt-ungora;  cisparity,  liuwever  slight,  in  narrow  f  i  el  d-of -vi  ew 
i:  - 1 :  o.', )  nu .  In  saccadic  eye  movement,  the  eye  accelerates  to 

iiiL'Ch  as  40,000-degrees/second/second,  attaining  a  velocity 
o-  400  to  ot’.'i -dr.'or  oes/sec  EerN-o  systems  tnat  are  capable 

v-Lta.niny  a'.cei  er-at:  uns  greater  tf;an 
n-;i ,  :''no-clegr  sec '--T'C’  'sec  ond  are  bevono  ttie  state-of-the-art . 

Ti- er  af  ur  e  chare  is  a  possibility  that  this  remoorai  disparity 
'■'ll  I  af-fs'.  >,  f-e  s  er  i  u  sc'me,  as  yet  unmown  way.  The  Air 
Eo.-  ce  Aer  umed  1  c  a  1  Labcratr.ry  lias  indicated  that  this  issue  is 
ijr.fc*  i.'-"  -1  r  uci'il  cent  t-'rn. 

T:i“  -.Maicht  a.-d  vs  1 1  c  s  r.-y  o-  the  i  s  SL>e  o-^  the  eve  mo-veiiieni 
’eiopor  =<i  d?.  spar  itv'  wi  c!  ;  r-  tf-'O  narrow  -►leld-of — /iew  rests  upon 

tie  '.luu'.  il-.-  of  visual  perception  following  saccadic  e-ve 
f'.c'  'air?';  t  .  Che  e:  pt?r  _  f':er  t  a  1  1  ;  t  er  at  ur  e  pertinent  to  the 

S’,  t  .IOC".  IS  1  r,  CG'-i-riict  on  this  issue.  L-n'r-  point  o-r  -view, 
o  sec  on  tte  1 1  l  e-'u  '  c  t  at  i  or.  o-f  e- p  i  rr.ent  a  1  rec-cits.  holds 
*'  it  peru-pi  -.on  is  ’i?ta‘‘t  at  the  end  o-f  the  sac-c-.-ce.  Arofier 
w  j  s;  L  1  U';-.- .  ecu'S;!'/  ss  e  :per  -  fiieutai  1  y  based,  suggesu's  that 
f  nr';--  ; i  pericr.  ^  (.'i-'!  cs-i''.ua'  li  ter'c:' /,  c  et  lia.c.-s  to  tt'e 
e;.  t  rri' t  o-r  1  ■  t  IP-'  vsec  .  f-oi  i  jwiug  an  occ-  iar"  saccade. 

Tie'--  sre  :i  ''le'--'-'.  i- =  i"  -..f--  ev  1 1.,-' i  ment  i-.  i  procedures  that 
•'igl  i  si. .  ■  ...I  v’ t  rr.i-  ei>'.e-  results,  if  there  i -=  a 

^  c-i  .-,.-  .  ij,  -.o;,  t'.  >■  1  1  at-'nc  V  .  t  oe  lelv.'  i  r:  vi'e  nar  r  ow 

■  1  e  I  g  -  Cl  — p- '  ese-r  :  i  Cf' ,  cr  i  u ,?  J  thrt  it  fails  witf'.ir;  the 
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1  .1'.  L'sec  or  s,o  tune  uei-  i  od  arter  a  saccade.  would  be 
1  r-isi  qn^ 1  uant .  Since  tt-'i's  issue  has  been  ceterininea  to  be  ot 
nis ’cr  SI  an  ’  -  i  cance  .  ano  ^ev.ew  ct  the  reievar.i:  iiLei'atu.'a 
ccts  not  urc.'Vioe  +t'r  ita  resolution,  it  niu.st  be  resolved 
i  per::i:er  tall/.  More  tiian  or'S-  en  pe-' i  mian  cal  sppr  oc-oh  nit?  v  be 
used  to  settle  this  issue.  One  app'i  oac:;i  is  to  design  an 
e;pef  iiiient  ti  at  w;  '1  al  1  ow  the  coai.'tv  or  percepL.'on 
t-i'  iowiny  a  sa-r.cac'e  Ln  be  fcapped  ti.ir  the  ru.ll  duration  of  the 
iterval.  Tie  resuits  would  be  o*  both  thieur  et  i  c  ai  ar.c 

Vt  lue.  An  “V.pe?’ i  nientai  pr  ocfadur  e  o+  more  practi-rai 
en.p'  u-ijs  ii.vCjIvss  ti:e  use  or  vat  lous  p  sytihol -q  i  ■:.al  procedu.-'es 
t'-.d-  tes-.-lt  ill  111:-  de-f ---r  !!■ .  p  ri 1  on  of  tiie  ■•emnoral  threshold 
rir  ^..e.' >.  t.-u  1 1  oi  toTluri'io  a  saccsds.  It  IS  possible  to 
_  ie’'t.jT/  I.!!-'  Oil.'  I  I  .i  ■_  s  t- t  i)t  j  ceab  1  e-u  1  f -f  erense  CJNEt'  for  a 
te'a-.ed  ii.t-i-ea  f  ;  e  Ni -of  V 1  ew  presentation  after  each,  s-aocade. 

[  :.t,  ifjt  r.iac  i“.  tlur  sub.ect  defines  tne  point  at  which  a 

'J.ri  o.y  in  pr  suer  t -d  1  cr>  becomes  perceptible.  It  is  precisel  •• 
n  s  U'.;::  1  i'.h.ai.  -fiust  te  met  liy  servo  itiov  ecie-nt  in  the 
Pr  3  i_'l' t  -Fye  eystem. 

Tli“  ei'.vi  r'Crii'ien  ..-.:iris>  oer  eo  for  the  app  1  i  c  at.  i  on  of  the 
ft  :gft-Eye  concept  fias  been  for'  high  oer-f ormance  nni.tary 
:.ii . af  c  flying  terrain  follov-jit-u  and  avoidance  (TFfTAl 
f:  .' ohtt  profiles  at  f'lght  or  during  bad  weather ,  Given  the 
duiitands  of  the  -^ligt^t  en  v  r  onmer-t  .  it  remains  for  the  pilot 
to  adapit  to  thent  to  the  e.^tent  that  the  probabilty  of  mission 
S:..ccs-3s  1=  high  and  his  p.er  sonal  safe-tv  teas.oiiabiy  assured. 

I'  adapting  to  t'ie  demands  of  this  tast;,  it  is  eu.pected  that 
■•■‘■.e  pilC't  viJi  1 1  oodifs  to  sente  degree,  (ns  ocular  movements  to 
corform  to  i.(  ese  demarcs,  thereby  increasing  the  ef-'^iciency 
of  visual  i  u-^t.iri'i.at.  i  on  acqi.isition  processes.  The 
f'odi  f  I  c  at  1  ori-s  ii.ay  ir'ciude  t  edut,  eci  tread  movement  since  it  is 

r  mat.  i.  c  1  1  V  slower  and  less  stable  than  eye  movement, 
greater  Sc  ccaci ;  c  e-!  cur  si  on  ^  ,  reduced  fixation  time,  and 
■ri':’' I  .i  f  1 -e  d  cr'iteria  for  evaluation  and  identification  of 
possible  targets.  Beyond  the  di lot's  adaptive  modifications, 
fiiere  are  envi r or^mert.ai  variables  ttiat  have  a  greater 
1  i  !' el  i  t'lOud  of  modifying  eye  movements,  as  for  example,  the 
presence  of  y— forces  concomitant  with  TF/TA  maneuvers.  These 
envi ronmental  conditions  and  pilot  adaptations  to  them  set 
the  specific  minimum  operational  r equi reiTients  for  the 
Bright-Eye  system  as  applied  to  hel met —mounted  displays.  The 
r  arige  o-^  values  for  tt^'ese  variables  can  only  be  estimated 
since  a  search  of  the  literature  has  not  revealed  any 
applicable  resear cfi  activity. 

Variations  of  the  SCVS  concept  have  also  been  installed  in 
a.  coclpit  simulator  and  experiments  are  planned  to  continue 
no  develop  advanced  pi i ot-cockpi t  interfaces  as  shown  in 
figure  3—7. 
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4  CONCLUSIONS 


In  the  queet  to  advance  the  state~of  — the— art  o-f 
human-systems  interaction  techniques,  care  must  be  exercised 
not  to  become  enthralled  Mith  unique  but  impractical 
developments.  It  is  quite  probable  that  no  single  device  will 
ever  prove  to  be  superior  for  all  applications.  The  same 
probability  holds  true  for  displays.  The  CRT  is  expected  to 
be  around  for  many  more  years  although  it  will  have  higher 
resolution  and  other  improvements  such  as  better  colors, 
reduced  depth,  3-dimensians,  etc..  Predictions  into  the 
future  are  always  perilous  and  therefore  none  will  be 
addressed  here  except  to  say  that  applications  for  new 
concepts  and  discoveries  seem  to  rely  more  upon  serendipity 
rather  than  organized  endeavors  to  identify  specific 
applications.  Changing  priorities  caused  by  the  impact  of 
program  requirements  requires  flexibility  and  adaptibility  in 
developing  innovative  displa/  and  control  techniques. 

The  sensor -coup led  research  has  evolved  into  other  areas  of 
application.  Among  which  are  the  use  of  eye-tracking  and 
voice  control  to  interact  with  computer-driven  displays  via 
an  oculometer,  eye— tracker,  and  voice  cc.itrol  module.  This 
effort  has  been  successfully  demonstrated  in  the  Westinghouse 
cockpit  simulator  previously  shown  in  figure  3-7  as  well  as 
interfaced  with  an  Apple  lie  as  shown  in  figure  4-1. 


Eye-CbmmiUKi  Concept 
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This  application  which  has  been  named  tye-Commana  to 
distinquish  it  -from  the  Bright— Eye  concept  promises  improved 
hLiman-systenis  interactions  -for  both  military  and  industrial 
operations.  In  addition  ,  the  concept  can  serve  as  an  aid  -for 
communication  by  cuadr i pi egi cs  or  persons  suffering  from 
severe  rieur  ol  og  i  cal  and/or  physiol  ogi  cal  disorders  that  make 
manual ,  vocal,  on  sign  language  communication  difficult  or 
impossible.  It  is  also  conceivable  that  the  concept  could  be 
criupled  wiif--  robots  or  automated  wor-k  stations  to  provide 
L'iofeedbat  -like  functions. 

Another  spin-off  was  a  program  funded  in  January,  1984  by 
the  IJ.S.  Arm>  ARMCCOM  DRDAR-SCF— IM  (D)  ,  Dover,  New  Jersey 
O'/SOI  entitled  ''Rifleman  Eye  Movement  Study".  The  objective 
of  the  study  was  to  collect  data  on  the  eye-movements  of  the 
combat  rifleman  as  he  siglits  in  his  target  and  fires  his 
weapon,  and  to  analyze  the  data  to  determine  if  identifiable 
patterns  eye  movement  were  exhibited  .  A  second  objective 
was  to  detern:ine  if  anticipatory  ocular  motions  occur  just 
prior  to  the  discharge  of  the  weapon.  The  study  was  conducted 
with  the  aid  of  the  U.S.  Marine  Corps  who  provided  the  range, 
weapons,  and  riflemen  at  the  U.S.  Mar'ine  Corps  Weapons 
Training  Battalion,  Quantico,  Virginia.  The  study  resulted  in 
the  at.quisition  of  significant  data  v^ihich  is  expected  to  lead 
to  the  des'elopment  of  techniques  to  improve  marksmanship. 
Figure  4-2  shows  a  photograph  of  a  riflemant  firing  an  M— 16 


Figure  4-2  Rifleman  Firing  M-16  While  Wearing  Qcuiometer 


A  third  applicj\tiDn  was  the  interest  generated  at  the 
Westlnghouse  Water  Reactor  Division,  Pittsburgh,  tor  using 
eye-blink  detection  eyeglasses  to  monitor  the  alertness  of 
nuclear  power  plant  operators.  Eye— Blink  detection  eyeglasses 
were  developed  as  a  spin-o-f-f  o-f  the  Eye— Command  concept. 

These  eyeglasses  incorporate  a  LED  emmitter  and  a  detector  to 
detect  the  occurrance  of  eyeblinks.  The  original  objective 
was  to  provide  a  means  for  sevei'ely  handicapped  people  to 
communicate  with  computers.  As  humans  start  to  drowse  off, 
the  duration  of  time  that  the  eye  remains  closed  during  each 
blink  is  indicative  of  the  reduced  activity  of  the  brain  and 
therefore  could  serve  to  alert  a  control  room  supervisor  or 
some  type  of  automatic  sensing  process  that  the  operator  was 
approaching  a  state  of  drowsiness. 

The  use  of  muscle-induced  or  brain— evoked  electrical 
potentials  to  provide  control  inputs  to  computers  are  other 
techniques  being  investigated  by  Westi nghouse.  A  direct 
physiologi cal  coupling  between  humans  and  computers  can  be 
accomplished  through  the  detection  of  electrical  potentials 
that  occur  during  the  contraction  of  certain  elements  of 
muscles.  These  potentials  are  then  modulated  into  signals 
which  are  converted  from  analog  into  digital  impulses  for 
input  into  a  microprocessor  whicn  controls  CRT  display  cursor 
X— y  deflection  or  an  electro-optical  gimbal  system. 

The  use  of  advanced  human-systems  interaction  techniques 
such  as  addressed  in  this  paper  is  of  special  interest  for 
continued  human  operation  in  environments  contaminated  by 
nuclear,  biological,  or  chemical  (NBC)  environments  and 
severe  climatical  conditions  such  as  winter  and  arctic 
operations.  During  these  conditions,  personnel  must  wear 
various  types  of  protective  garments  which  because  of  their 
bulkiness,  makes  it  very  difficult,  and  in  many  cases, 
impossible,  for  humans  to  operate  controls. 

And  finally,  no  contemporary  paper  can  be  complete  without 
reference  to  artificial  intelligence  (AI).  Westinghouse 
interest  in  robotics  and  AI  goes  back  tu  the  early  1930 's 
when  Westinghouse  designed  and  constructed  a  number  of 
automatons  including  Electro  that  could  walk  and  talk  and 
could  discriminate  between  the  colors  red  and  green.  Electro 
also  had  a  robot  dog  that  could  also  walk.  Westinghouse  is 
applying  AI ,  expert  systems,  and  knowledge  engineering 
techniques  to  the  design  and  development  of  advanced  military 
systems.  Many  areas  of  concern  are  being  addressed  such  as 
the  inflexibilty  of  AI  to  respond  to  the  dynamics  of  tactical 
dec i SI or-making.  Since  the  real— world  is  exception-driven, 
unpredictable  variables  can  be  expected  to  occur  which  has  a 
major  impact  on  AI  driven  systems.  Perhaps  the  importance  of 
flexibility  and  adaptibility  can  best  be  summed  up  by  this 


quotation  -from  Karl  Von  ClauHwitz; 

Since  all  in  +  orn>ation  and  assumptions  are  open  to 
doubt,  and  with  chance  at  work  everywhere,  the 
commander  continually  -finds  that  things  are  not  as 
he  expected. 

Where  does  all  ot  this  lead  us  ?  When  will  computers  take 
on  the  attributes  o-f  human  beings'?  Perhaps  the  answer  can  be 
summed  up  by; 


;ihen  vc'j  osfsit  vour  ;(aij9ht“r  to  earrv 
one. 
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Abstract 


Modern  avionic  sy.stem>  and  display  capabilities  provide  crew  station  designs  with  unparal¬ 
leled  tlexibility  in  the  manner  in  which  information  is  presented  to  the  aircrew.  In  the  headlong 
rush  to  incorporate  these  technologies,  we  seem  to  be  losing  sight  of  the  important  role  standard¬ 
ization  has  played  in  impioving  flight  safety  and  in  reducing  procurement  and  support  costs.  Cur¬ 
rent  design  standards  do  not  reflect  lessons  learned  or  capabilities  made  possible  by  technological 
advances  over  the  past  ten  years  and  are  badly  in  need  of  revision  or  replacement. 

Technological  advances,  both  existing  and  on  the  horizon,  such  as  artificial  intelligence,  voice 
command,  electronic  instrument  panels,  and  automation  in  general,  will  offer  the  designer  even 
more  options  in  formatting  and  locating  intormation  presented  to  the  aircrew.  If  completely 
unrestrained,  this  flexibility  will,  in  the  not  too  distant  future,  result  in  a  massive  and  expensive 
training  transition  problem  and  will  adversely  impact  flight  safety,  vehicle  procurement,  and  sup¬ 
port  costs.  Thus,  perhaps  more  than  ever,  attention  must  be  focused  on  the  role  standardization 
is  to  have  in  the  design  of  future  crew  stations. 

This  paper  presents  background  on  the  history  of  some  present  standards,  illustrates  the  lack 
of  adherence  to  them,  and  presents  arguments  in  favor  of  increased  emphasis  on  the  standardiza¬ 
tion  of  future  crew  station  designs. 


Introduction 

Before  a  case  can  be  made  for  aircrew  station  standardization,  an  understanding  of  why  and 
how  it  originally  came  into  being  may  prove  helpful  (particularly  for  those  of  us  who  weren’t  around 
then).  For  this  reason,  and  because  the  author  believes  that  history  is  about  to  repeat  itself,  this 
paper  begins  with  an  historical  perspective  on  crew  station  standardization. 


Historical  Perspective 


During  the  late  1940s  and  early  1950s,  particularly  during  the  transition  from  propellers  to 
jets,  the  operational  and  safety  communities  within  the  armed  services  became  increasingly  aware 
that  the  lack  of  standardization  was  contributing  to  a  very  poor  accident  rate  history.  Aircrews 
made  the  transition  from  one  make  and  model  of  aircraft  to  another  largely  by  reading  the  flight 
manual  and  perhaps  by  passing  a  blindfold  check  in  the  cockpit.  The  format  and  content  of  the 
flight  manuals  themselves  w'ere  largely  determined  by  the  individual  aircraft  manufacturers.  There 
w'ere  no  Naval  Aviation  Training  and  Operational  Procedures  (NATOPS),  no  commonly  accepted 
standard  arrangement  of  flight  instruments,  no  standards  for  the  placement  of  controls,  no  re¬ 
quirements  for  shape  coding  of  various  secondary  controls  (such  as  those  for  flaps  and  landing 
gear),  and  no  standards  for  relating  the  direction  of  the  control  motion  to  its  effect  on  the  aircraft 
performance  or  the  position  of  the  device  operated  by  the  control.  Given  enough  time,  the  crewman 
simply  adapted  to  the  cockpit  configuration  and  quirks  of  the  aircraft  he  was  currently  Hying  and 
usually  experienced  no  difficulty. 
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However,  when  difficulties  arose  or  the  crewman  became  complacent,  and  particularly  if  he 
were  more  experienced,  he  often  reverted  to  old  habits  which  sometimes  produced  disastrous  results. 
During  a  sudden  encounter  with  instrument  flight  rules  (IFR)  conditions,  the  instrument  scan  pat¬ 
tern  he  had  developed  after  many  hours  in  an  older  aircraft  suddenly  had  to  be  relearned  because 
the  panel  arrangement  of  the  new  aircraft  was  different.  In  another  instance,  when  he  reached  for 
where  he  instinctively  knew  the  flap  handle  was,  he  got  the  gear  handle  which  usually  resulted  in 
gear  retraction  during  rollout  after  a  landing;  or,  when  he  moved  a  fuel  selector  valve  in  the  direc¬ 
tion  he  was  accustomed  to  for  selecting  an  auxiliary  tank,  the  fuel  was  turned  off  in  the  new  airplane. 

Another  intriguing  variation  was  the  short-lived  difference  in  attitude  indicator  presentations. 
In  some  aircraft  it  was  outside-in,  i.e.,  the  horizon  was  fixed  and  the  miniature  airplane  moved 
with  respect  to  it  in  pitch  and  roll;  in  the  majority  of  other  aircraft,  it  was  inside-out  (present  case), 
i.e.,  the  miniature  airplane  is  fixed  and  the  horizon  line  is  free  to  move.  Another  frequently  found 
variation  was  in  the  bank  angle  presentation.  In  some  cases  the  indicator  moved  opposite  to  the 
direction  of  turn;  in  others  it  moved  in  the  direction  of  the  turn. 

In  recognition  of  the  problems  created  by  such  situations  as  well  as  the  impact  that  standard¬ 
ization  could  have  on  reducing  costs  and  increasing  utilization  of  increasingly  complex  aircraft, 
DOD  in  1951  established  what  is  now  known  as  the  Aircrew  Station  Standardization  Panel  (ASSP). 
Make-up  of  ASSP  eventually  included  Air  Force,  Navy,  and  Army  members;  NASA,  FAA,  and 
industry  representadves  served  in  an  advisory  capacity.  The  ASSP  effort  produced  most  of  the 
crew  station  design  standards  which  exist  today.  The  civilian  counterpart  of  ASSP,  the  Society 
of  Automotive  Engineers  Cockpit  Standardization  Committee  performed  a  similar  service  for  com¬ 
mercial  aviation. 

As  the  standardization  effort  matured  and  gradually  bore  fruit,  the  ASSP  met  with  decreasing 
frequency  in  the  1970s  and  then  became  virtually  dormant  from  June  1980  to  1983.  Thus,  during 
the  years  in  which  some  of  the  most  explosive  growth  in  crew  station  technologies  took  place,  the 
ASSP’s  activity  and  involvement  with  this  growth  was,  and  continues  to  be,  at  an  ebb. 


Is  Standardization  Still  Needed? 

Some  might  argue  that  the  need  for  standardization  is  no  longer  as  pressing  as  it  once  was 
in  view  of  current  and  future  operating  policies  which  call  for  very  extensive  and  formalized  transi¬ 
tion  training,  and  which  reduce  the  frequency  with  which  aircrew  are  apt  to  change  to  different 
aircraft.  Another  argument  is  that  reduced  numbers  and  models  of  aircraft  being  procured  do  not 
warrant  the  effort  involved  in  standardization.  Yet  another  frequently  heard  contention  is  that 
development  of  new  standards  would  be  counter  to  the  present  trend  toward  deregulation. 

The  author’s  reply  to  these  arguments  is  that  the  essential  reasons  for  standardization  (safety 
of  human  life,  preservation  of  valuable  equipment,  and  cost  reduction  in  both  design  and  procure¬ 
ment)  are  overriding  and  that  the  crew  station  of  the  future  requires  standardization  as  much  as, 
if  not  more  than,  those  of  the  past. 

The  flexibility  inherent  in  many  present  and  certainly  all  future  “glass  cockpits”  presents  us 
with  the  strong  possibility  of  both  inducing  leu-ge  expenditures  in  manpower  and  dollars  to  develop 
new  configurations  and,  conversely,  unparalleled  opportunities  for  cost  reduction  through  stan¬ 
dardization. 


Increases  in  development  costs  will  arise  as  a  result  of  the  flexibility  in  display  format  and 
location  within  the  crew  station  afforded  us  by  modern  avionics/display  systems.  The  trend  is  clearly 
toward  automated  display  management  and  multifunction  displays.  These  capabilities  plus  the  ad¬ 
vent  of  integrated  flight  and  thrust  management,  integrated  flight/fire  control  systems,  etc.,  pro¬ 
vide  a  crew  station  design  team  with  a  bewildering  array  of  choices  in  both  display  format  and 
location.  Extensive  analytical  and  simulation  efforts  will  be  required  to  arrive  at  an  acceptable  con¬ 
figuration.  The  software  required  will  correspondingly  grow'  in  complexity  and  cost.  Software 
development  will  probably  be  the  largest  cost  driver  in  future  crew  station  design.  How  then,  will 
the  design  team  make  the  decisions  necessary  to  establish  a  safe  and  manageable  crew-  station 
configuration? 

One  answer  is  through  the  application  of  appropriate  human  engineering  analysis  and  testing 
techniques.  Depending  upon  mission  requirements  and  aircrait  complexity,  this  can  be  a  long  and 
expensive  undertaking.  Why  not  reduce  the  magnitude  of  this  task  to  some  extent  by  standardizing 
format  and  location  of  at  least  the  basic  information  required  to  fly  the  airplane:  airspeed,  altitude, 
attitude,  and  heading/course?  Can  performance  variations  among  aircraft  of  a  particular  configura¬ 
tion  and  mission  type  (i.e.,  fixed  wing  fighters)  be  so  great  as  to  warrant  differences  in  where  and 
how  this  information  is  displayed? 

The  author  does  not  believe  so.  But,  an  examination  of  current  and  proposed  electronic  displays 
for  basic  flight  information  reveals  a  wide  variation  in  formats,  from  replication  of  existing  “boiler 
gages”  to  3-D  ant  log  displays,  as  shown  in  Figure  1. 

Likewise,  a  comparison  of  the  displays  in  various  operational  aircraft  with  each  other  and 
with  the  requirements  of  M1L-STD-884C,  as  shown  in  Figure  2,  reveals  many  variations  and  depar¬ 
tures  from  its  requirements. 

The  other  solution  is  to  simply  place  things  in  the  crew  station  as  they  were  in  the  preceding 
airplane  design.  This  approach  could  be  considered  a  form  of  standardization  in  its  simplest  inter¬ 
pretation.  This  method  tends  to  perpetuate  mistakes.  In  the  case  of  future  aircraft,  it  will  result 
in  unnecessarily  large  and  expensive  crew  stations. 

A  new  safety  consideration  brought  on  by  the  automation  which  makes  “glass  cockpits”  possible 
is  software  quality  control.  Despite  all  the  component  and  systems  redundancy  designed  into  modern 
aircraft,  it  is  believed  that  the  picture  tubes  will  occasionally  go  blank,  more  than  likely  from  a 
software  glitch  rather  than  a  hardware  failure.  One  way  to  minimize  the  likelihood  of  such  occur¬ 
rences  is  to  minimize  the  number  of  iterations  required  to  produce  software  used  for  basic  cockpit 
displays. 
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Fig.  2  Symbology  Comparison 


Impacts  on  Software 

As  mentioned  previously,  software  deve^oment  is  now  a  significant  safety  and  cost  factor 
in  the  development  of  a  new  aircraft  and  will  become  even  more  so  in  the  future.  Standardization 
could  help  to  reduce  software  costs  by: 

•  Reducing  or  eliminating  much  of  the  repetitive  effort  which  goes  into  developing  and 
substantiating  display  symbology  for  each  new  make  and  model  of  aircraft 

•  Increasing  commonality  of  software  for  driving  flight  displays,  training  devices,  and 
support  equipment. 

An  attemp*  by  ASSP  to  standardize  electronically  generated  displays  in  the  late  1960’s  resulted 
in  the  publication  of  MIL-STD-884.  It  was  last  revised  in  1972  (M1L-STD-884C)  and,  as  is  ap¬ 
parent  by  a  review  of  Figure  2,  there  have  been  many  deviations  from  it.  MIL-$TD-884  needs  to 
be  thoroughly  revised  or  replaced  with  a  new  standard  which  reflects  the  knowledge  gained  in  display 
symbology  and  formatting  since  1972.  While  this  effort  is  ongoing,  consideration  should  be  given 
to  standardizing  weapons  delivery  symbology.  Table  1  lists  some  possible  candidates  for  stan¬ 
dardization;  some  of  these  are  included  in  MIL-SrD-884C. 


TABLE  1  SYMBOLOGY  STANDARDIZATION  CANDIDATES 


HORIZON 

AIRSPEED 

ALTITUDE 

ANGLE  OF  ATTACK 

VERTICAL  VELOCITY 

PITCH  ANGLE 

BANK  ANGLE 

RATE  OF  TURN 

SLIP/SKID 

VELOCITY  VECTOR 

HEADING 

COURSE 

WAYPOINT 

WEAPON  AIMING/RELEASE 

-  GUNS/BULLET  TRAJECTORY 

-  I/R  MISSILES 

-  RADAR  MISSILES 

-  TV 

-  BOMBS/BOMB  TRAJECTORY 

-  ROCKETS 

-  TIME/TO  RELEASE/UNTIL  IN  RANGE/CLOSURE  RATE 

-  LAUNCH  ENVELOPE 

-  TARGET  DESIGNATOR 

-  ALLOWABLE  STEERING  ERROR 

-  ETC 

ACCELERATION 
OWN  AIRCRAFT 
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In  addition  to  the  above,  existing  standards  need  to  be  revised  and/or  new  standards  need 
to  be  established  for  both  information  location  and  display  arrangement  as  illustrated  by  Figures 
3  and  4.  The  same  can  be  said  for  several  other  existing  standards  which  have  been  very  much 
a  part  of  any  crew  station  design  consideration. 

•  MlL-STD-203  -  Aircrew  Station  Controls  and  Displays  -  Assignment,  Location  and  Ac¬ 
tuation  of,  for  Fixed  Wing  Aircraft 

•  MIL-STD-250  -  Aircrew  Station  Controls  and  Displays  for  Rotary  Wing  Aircraft 

•  MIL-STD-411  -  Aircrew  Station  Signals. 

All  of  the  above  are  woefully  out  of  date  when  viewed  in  light  of  present  practices  in  the  in¬ 
dustry.  An  effort  to  accomplish  this  task  was  begun  by  ASSP  at  their  meeting  in  June,  1983. 

Any  standards  developed  must  consider  not  only  what  is,  but  also  the  aircraft  systems  which 
will  be  operating  in  the  year  2000  in  order  to  avoid  creating  a  massive  training  transition  problem. 
Much  research  has  been  accomplished,  and  there  are  many  programs  such  as  the  USAF  Advanced 
Systems  Integration  Demonstrations  (ASIDS)  and  Microcomputer  Applications  of  Graphics  and 
Interactive  Communications  (MAGIC),  which  currently  are  addressing  such  avionics  systems  and 
display  issues.  These  programs  must  be  closely  monitored,  and  the  results  obtained  must  be  incor¬ 
porated  into  the  standards  as  appropriate. 

By  the  same  token,  the  author  realizes  that  total  standardization  is  neither  feasible  nor  desirable 
since  nonstandard  formats  will  need  to  be  developed  to  meet  technological  changes  and  tactical 
requirements.  However,  much  could  be  accomplished  by  the  standardization  of  flight  and  tactical 
displays. 


NOTE;  SEE  MIU-STD-XXX  FOR  DISPLAY  ARRANGEMENT. 
SEE  MIL-STO  YYY  FOR  DISPLAY  SYMBOLOGY. 
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ALTITUDE 

VERTICAL  VELOCITY 


-  HEADING  j 
-COURSE  >  STATUS 
-BEARING  ) 

COURSE  (SELECTED) 


PRESENT  POSITION 


GROUND  SPEED 


INPUT  DATA  BLOCK 

-  LAT/LONG 
-WAYPOINT 

-  MAP  SCALE 

-  ORIENTATION  INORT  UP/HDG  UP) 


SUBSYSTEMS  DATA 

-  ARMAMENT 

-  FUEL 

-  PROPULSION 

-  CHECKLISTS 
ETC 


/. 


<t 


PILOT 


HUD 


FLIGHT  PATH  INFO 

TERRAIN  CLEARANCE 
WEAPON  AIMING 
WEAPON  STATUS 
ETC 


SUBSYSTEM  CONTROLS  ICNI.  ETC) 
DATA  ENTRY 
MASTER  WARN,  CAUTION 
DATA  LINK  MESSAGE 


SENSOR  DATA 

-  RADAR 
FLIR 

-  IRST 

-  TV 

-  ETC 


VSD 

(MFD) 


flight  path  INFO 

-  TERRAIN  CLEARANCE 

-  WEAPON  aiming 

-  WEAPON  status 

-  ETC 

(IF  VSD  IS  NOT  installed 
HSO  IS  LOCATED  HERE) 


HSD 


NAVIGATION 
TACTICAL  DATA 
ECM  DATA 


STANDBY  flight 
INSTRUMENTIS) 
(IF  REQD) 


NOTES: 

1.  SEE _ FOR  INFORMATION 

LOCATION  REQUIREMENTS. 

2.  SEE _ FOR  SYMBOLOGY. 

3.  DATA  LISTED  FOR  EACH  DISPLAY  IS 
PRIMARY  FOR  THAT  DISPLAY  AND 
WILL  NORMALLY  BE  LOCATED  THERE. 

4.  IN  THE  EVENT  OF  DISPLAY  failure, 
INFORMATION  NORMALLY  FOUND 
ON  THAT  DISPLAY  MAY  BE  SHIFTED 
TO  ETC,  ETC. 
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Fig.  4  Display  Arrangement  &  Information  Location  Standard  (Example) 
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Conclusion 


If  for  no  other  reason,  potential  cost  savings  should  drive  DOD  toward  renewed  emphasis 
on  standardization.  It  does  not  take  much  imagination  to  recognize  the  benefits  which  could  ac¬ 
crue  from  the  standardization  of  flight  information  formats,  symbology,  and  display  locations  and, 
conversely,  the  chaos  which  could  ensue  in  the  absence  of  standardization. 

The  mechanism  required  to  achieve  this  goal  already  exists  in  the  form  of  the  ASSP.  ASSP’s 
primary  thrust  would  be  to  bring  about  agreement  on  interservice  standards  for  display  size,  loca¬ 
tion,  and  formats.  Industry  should  participate  through  the  Aircraft  Industries  Association  (AlA) 
to  assist  ASSP  in  the  development  of  the  necessary  standards. 

The  choice  is  clear.  We  can  continue  to  allow  standardization  to  drift  at  the  expense  of  flight 
safety  and  program  cost  or  we  can  grasp  the  potential  that  new  technology  offers;  true  stan¬ 
dardization  on  an  interservicc  basis  with  benefits  to  both  safety  and  cost. 
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